Sep 16 16:01:48 devstack cinder-volume[75147]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 16 16:01:48 devstack cinder-volume[75147]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 16 16:01:48 devstack cinder-volume[75147]: we strongly recommend against using it for new projects.
Sep 16 16:01:48 devstack cinder-volume[75147]: If you are already using Eventlet, we recommend migrating to a different
Sep 16 16:01:48 devstack cinder-volume[75147]: framework.  For more detail see
Sep 16 16:01:48 devstack cinder-volume[75147]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 16 16:01:48 devstack cinder-volume[75147]:   import eventlet  # noqa
Sep 16 16:01:51 devstack cinder-volume[75147]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75147) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 16 16:01:51 devstack cinder-volume[75147]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75147) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 16 16:01:51 devstack cinder-volume[75147]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75147) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 16 16:01:52 devstack cinder-volume[75147]: INFO dbcounter [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Registered counter for database cinder
Sep 16 16:01:52 devstack cinder-volume[75147]: DEBUG oslo_db.sqlalchemy.engines [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75147) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 16:01:52 devstack cinder-volume[75147]: DEBUG dbcounter [-] [75147] Writer thread running {{(pid=75147) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 16 16:01:52 devstack cinder-volume[75147]: INFO cinder.rpc [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 16 16:01:52 devstack cinder-volume[75147]: INFO cinder.rpc [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 16 16:01:52 devstack cinder-volume[75147]: DEBUG oslo_db.sqlalchemy.engines [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75147) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 16:01:52 devstack cinder-volume[75147]: INFO cinder.volume.manager [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Determined volume DB was empty at startup.
Sep 16 16:01:52 devstack cinder-volume[75147]: DEBUG cinder.volume.manager [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75147) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 16 16:01:52 devstack cinder-volume[75147]: INFO cinder.volume.manager [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 16 16:01:52 devstack cinder-volume[75147]: WARNING stevedore.named [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 16 16:01:52 devstack cinder-volume[75147]: WARNING castellan.key_manager [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 16:01:52 devstack cinder-volume[75147]: WARNING cinder.keymgr.conf_key_mgr [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 16:01:52 devstack cinder-volume[75147]: DEBUG cinder.volume.drivers.lvm [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75147) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 16 16:01:52 devstack cinder-volume[75147]: DEBUG oslo_concurrency.processutils [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75147) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_concurrency.processutils [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] CMD "cinder-rtstool verify" returned: 0 in 0.432s {{(pid=75147) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_db.sqlalchemy.engines [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75147) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 16:01:53 devstack cinder-volume[75147]: INFO cinder.rpc [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 16 16:01:53 devstack cinder-volume[75147]: INFO cinder.rpc [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 16 16:01:53 devstack cinder-volume[75147]: WARNING stevedore.named [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 16 16:01:53 devstack cinder-volume[75147]: WARNING castellan.key_manager [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 16:01:53 devstack cinder-volume[75147]: INFO cinder.volume.manager [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_db.sqlalchemy.engines [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75147) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 16:01:53 devstack cinder-volume[75147]: INFO oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Starting 1 workers
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Started child 75332 {{(pid=75147) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Full set of CONF: {{(pid=75147) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] ******************************************************************************** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Configuration options gathered from: {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] ================================================================================ {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] allow_availability_zone_fallback = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] allow_compression_on_image_upload = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75332]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] allowed_direct_url_schemes     = [] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] api_rate_limit                 = True {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] auth_strategy                  = keystone {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] az_cache_duration              = 3600 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_availability_zone      = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_host                   = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_name                   = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_stats_polling_interval = 60 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backup_api_class               = cinder.backup.api.API {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backup_name_template           = backup-%s {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backup_use_same_host           = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backup_use_temp_snapshot       = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] chap_password                  = **** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] chap_username                  =  {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cinder_internal_tenant_project_id = 9f8fd6342eba499cb62787127d5fef23 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cinder_internal_tenant_user_id = 5bdcb0849c4649b49c76bcb1e14f7f00 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cloned_volume_same_az          = True {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cluster                        = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] compression_format             = gzip {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] config_dir                     = [] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] config_source                  = [] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] control_exchange               = openstack {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] debug                          = True {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] default_availability_zone      = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] default_group_type             = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] default_volume_type            = lvmdriver-1 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] disk_geometry                  = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] driver_client_cert             = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] driver_client_cert_key         = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] driver_data_namespace          = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] driver_ssl_cert_path           = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] driver_ssl_cert_verify         = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] driver_use_ssl                 = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] enable_force_upload            = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] enable_new_services            = True {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] enable_unsupported_driver      = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] enforce_multipath_for_image_xfer = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] filter_function                = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] glance_api_insecure            = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] glance_api_servers             = ['http://192.168.122.127/image'] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] glance_api_ssl_compression     = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] glance_ca_certificates_file    = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] glance_certfile                = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] glance_keyfile                 = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] glance_num_retries             = 3 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] glance_request_timeout         = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] goodness_function              = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] graceful_shutdown_timeout      = 5 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] group_api_class                = cinder.group.api.API {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] host                           = devstack {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] image_compress_on_upload       = True {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] image_conversion_address_space_limit = 1 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] image_conversion_cpu_limit     = 60 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] image_conversion_disable       = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] image_introspection_address_space_limit = 1 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] image_introspection_cpu_limit  = 60 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] image_upload_use_cinder_backend = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] image_upload_use_internal_tenant = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] image_volume_cache_enabled     = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] image_volume_cache_max_count   = 0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] image_volume_cache_max_size_gb = 0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] init_host_max_objects_retrieval = 0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] iscsi_target_flags             =  {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] iscsi_write_cache              = on {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] iser_helper                    = tgtadm {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] iser_ip_address                = 192.168.122.127 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] iser_port                      = 3260 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] log_color                      = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] log_config_append              = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] log_dir                        = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] log_file                       = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] log_options                    = True {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] log_rotate_interval            = 1 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] log_rotate_interval_type       = days {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] log_rotation_type              = none {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] max_age                        = 0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] max_logfile_count              = 30 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] max_logfile_size_mb            = 200 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] max_over_subscription_ratio    = 20.0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] message_reap_interval          = 86400 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] message_ttl                    = 2592000 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] migration_create_volume_timeout_secs = 300 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] monkey_patch                   = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75332]: INFO cinder.volume.manager [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] monkey_patch_modules           = [] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] my_ip                          = 192.168.122.127 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] no_snapshot_gb_quota           = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] num_iser_scan_tries            = 3 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] num_shell_tries                = 3 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] num_volume_device_scan_tries   = 3 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] nvmeof_conn_info_version       = 1 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] nvmet_ns_id                    = 10 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] nvmet_port_id                  = 1 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] osapi_max_limit                = 1000 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] osapi_volume_ext_list          = [] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] osapi_volume_listen_port       = 8776 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] osapi_volume_use_ssl           = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] osapi_volume_workers           = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] per_volume_size_limit          = -1 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] periodic_fuzzy_delay           = 60 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] periodic_interval              = 60 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] public_endpoint                = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] publish_errors                 = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] quota_backup_gigabytes         = 1000 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] quota_backups                  = 10 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] quota_gigabytes                = 1000 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] quota_groups                   = 10 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] quota_snapshots                = 10 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] quota_volumes                  = 10 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] rate_limit_burst               = 0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] rate_limit_except_level        = CRITICAL {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] rate_limit_interval            = 0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] reinit_driver_count            = 3 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] replication_device             = **** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] report_discard_supported       = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] report_interval                = 120 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] reservation_clean_interval     = 86400 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] reservation_expire             = 86400 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] reserved_image_namespaces      = [] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] reserved_percentage            = 0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] rpc_response_timeout           = 120 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] run_external_periodic_tasks    = True {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] scst_target_driver             = iscsi {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] scst_target_iqn_name           = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] service_down_time              = 720 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] shell_completion               = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] snapshot_name_template         = snapshot-%s {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] snapshot_same_host             = True {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] split_loggers                  = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] state_path                     = /opt/stack/data/cinder {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] storage_availability_zone      = nova {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] storage_protocol               = iSCSI {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] syslog_log_facility            = LOG_USER {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] target_helper                  = lioadm {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] target_ip_address              = 192.168.122.127 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] target_port                    = 3260 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] target_protocol                = iscsi {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] target_secondary_ip_addresses  = [] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] trace_flags                    = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] transport_url                  = **** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] until_refresh                  = 0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] use_chap_auth                  = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] use_default_quota_class        = True {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] use_journal                    = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] use_json                       = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] use_multipath_for_image_xfer   = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] use_stderr                     = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] use_syslog                     = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] verify_glance_signatures       = enabled {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] volume_api_class               = cinder.volume.api.API {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] volume_backend_name            = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] volume_clear                   = zero {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] volume_clear_ionice            = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] volume_clear_size              = 0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] volume_copy_bps_limit          = 0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] volume_dd_blocksize            = 1M {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] volume_name_template           = volume-%s {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] volume_service_inithost_offload = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] volume_usage_audit_period      = month {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] zoning_mode                    = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_concurrency.disable_process_locking = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.auth_section = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.auth_type   = password {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.auth_version = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.cache       = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.certfile    = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.include_service_catalog = True {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.insecure    = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.interface   = public {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.keyfile     = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.memcache_password = **** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.memcache_username = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.region_name = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.service_type = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.127/identity {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.backend                  = dogpile.cache.null {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.backend_argument         = **** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.backend_expiration_time  = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.config_prefix            = cache.oslo {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.debug_cache_backend      = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.enable_retry_client      = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.enable_socket_keepalive  = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.enabled                  = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.expiration_time          = 600 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.hashclient_retry_attempts = 2 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.memcache_dead_retry      = 300 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.memcache_sasl_enabled    = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.password                 = **** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.proxies                  = [] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.redis_db                 = 0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.redis_server             = localhost:6379 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.retry_attempts           = 2 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.retry_delay              = 0.0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.socket_keepalive_count   = 1 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.socket_keepalive_idle    = 1 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.socket_keepalive_interval = 1 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.socket_timeout           = 1.0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.tls_allowed_ciphers      = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.tls_cafile               = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.tls_certfile             = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.tls_enabled              = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.tls_keyfile              = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cache.username                 = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] coordination.backend_url       = **** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.asyncio_connection    = **** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.asyncio_slave_connection = **** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.backend               = sqlalchemy {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.connection            = **** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.connection_debug      = 0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.connection_parameters =  {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.connection_recycle_time = 3600 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack sudo[75388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 16 16:01:53 devstack sudo[75388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.connection_trace      = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.db_inc_retry_interval = True {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.db_max_retries        = 20 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.db_max_retry_interval = 10 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.db_retry_interval     = 1 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.max_overflow          = 50 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.max_pool_size         = 5 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.max_retries           = 10 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.mysql_wsrep_sync_wait = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.pool_timeout          = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.retry_interval        = 10 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.slave_connection      = **** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.sqlite_synchronous    = True {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.synchronous_reader    = True {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] database.use_db_reconnect      = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_tracing.insecure = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] profiler.connection_string     = messaging:// {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] profiler.enabled               = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] profiler.es_doc_type           = notification {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] profiler.es_scroll_size        = 10000 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] profiler.es_scroll_time        = 2m {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] profiler.filter_error_trace    = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] profiler.hmac_keys             = **** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] profiler.sentinel_service_name = mymaster {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] profiler.socket_timeout        = 0.1 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] profiler.trace_requests        = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] profiler.trace_sqlalchemy      = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] profiler_jaeger.process_tags   = {} {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] profiler_jaeger.service_name_prefix = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] profiler_otlp.service_name_prefix = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_policy.enforce_new_defaults = True {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_policy.policy_default_rule = default {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] privsep_osbrick.group          = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] privsep_osbrick.helper_command = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] privsep_osbrick.user           = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cinder_sys_admin.group         = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cinder_sys_admin.helper_command = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] cinder_sys_admin.user          = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] service_user.auth_section      = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] service_user.auth_type         = password {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] service_user.cafile            = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] service_user.certfile          = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] service_user.collect_timing    = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] service_user.insecure          = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] service_user.keyfile           = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] service_user.send_service_user_token = True {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] service_user.split_loggers     = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] service_user.timeout           = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] service_user.tls_ciphers       = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] service_user.tls_min_version   = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] glance.auth_section            = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] glance.auth_type               = password {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] glance.certfile                = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] glance.collect_timing          = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] glance.insecure                = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] glance.keyfile                 = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] glance.region_name             = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] glance.split_loggers           = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] glance.timeout                 = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] glance.tls_ciphers             = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] glance.tls_min_version         = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.backend_availability_zone = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.chap_password = **** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.chap_username =  {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.disk_geometry = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.driver_client_cert = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.driver_client_cert_key = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.driver_data_namespace = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.driver_use_ssl = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.extra_capabilities = {} {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.filter_function = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.goodness_function = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.iscsi_target_flags =  {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.iscsi_write_cache = on {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.iser_ip_address = 192.168.122.127 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.iser_port     = 3260 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.lvm_share_target = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.lvm_type      = auto {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.num_shell_tries = 3 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.replication_device = **** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.report_discard_supported = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.reserved_percentage = 0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.target_helper = tgtadm {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.target_ip_address = 192.168.122.127 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.target_port   = 3260 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.target_protocol = iscsi {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.trace_flags   = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.unique_fqdn_network = True {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.use_chap_auth = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.volume_backend_name = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.volume_clear  = zero {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.volume_clear_ionice = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.volume_clear_size = 0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_reports.file_event_handler = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_reports.log_dir           = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.backend_host       = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.chap_password      = **** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.chap_username      = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.disk_geometry      = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.driver_client_cert = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.extra_capabilities = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.filter_function    = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.goodness_function  = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.iser_helper        = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.iser_port          = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.lvm_type           = auto {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.replication_device = **** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.report_discard_supported = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.reserved_percentage = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.scst_target_driver = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.storage_protocol   = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.target_ip_address  = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.target_port        = 3260 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.trace_flags        = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.volume_clear       = zero {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] lvmdriver-1.volumes_dir        = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_notifications.driver = [] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_notifications.retry = -1 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] key_manager.fixed_key          = **** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican.barbican_api_version  = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican.barbican_endpoint     = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican.barbican_endpoint_type = public {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican.barbican_region_name  = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican.cafile                = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican.certfile              = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican.collect_timing        = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican.insecure              = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican.keyfile               = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican.number_of_retries     = 60 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican.retry_delay           = 1 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican.send_service_user_token = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican.split_loggers         = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican.timeout               = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican.tls_ciphers           = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican.tls_min_version       = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican.verify_ssl            = True {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican.verify_ssl_path       = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican_service_user.auth_section = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican_service_user.auth_type = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican_service_user.cafile   = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican_service_user.certfile = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican_service_user.collect_timing = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican_service_user.insecure = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican_service_user.keyfile  = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican_service_user.split_loggers = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican_service_user.timeout  = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican_service_user.tls_ciphers = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] barbican_service_user.tls_min_version = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] vault.approle_role_id          = **** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] vault.approle_secret_id        = **** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] vault.auth_method              = approle {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] vault.auth_path                = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] vault.kv_mountpoint            = secret {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] vault.kv_path                  = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] vault.kv_version               = 2 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] vault.namespace                = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] vault.root_token_id            = **** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] vault.ssl_ca_crt_file          = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] vault.timeout                  = 60.0 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] vault.token_file               = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] vault.token_role               = None {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] vault.use_ssl                  = False {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:01:53 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] ******************************************************************************** {{(pid=75147) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 16 16:01:54 devstack sudo[75388]: pam_unix(sudo:session): session closed for user root
Sep 16 16:01:54 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.411s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:54 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:54 devstack sudo[75532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 16:01:54 devstack sudo[75532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:01:54 devstack sudo[75532]: pam_unix(sudo:session): session closed for user root
Sep 16 16:01:54 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.295s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:54 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:01:54 devstack cinder-volume[75332]: INFO cinder.brick.local_dev.lvm [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 16 16:01:54 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:54 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:54 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:54 devstack sudo[75645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 16:01:54 devstack sudo[75645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:01:54 devstack sudo[75645]: pam_unix(sudo:session): session closed for user root
Sep 16 16:01:54 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:54 devstack cinder-volume[75332]: DEBUG cinder.brick.local_dev.lvm [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75332) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 16 16:01:54 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:54 devstack sudo[75728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 16:01:54 devstack sudo[75728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:01:56 devstack sudo[75728]: pam_unix(sudo:session): session closed for user root
Sep 16 16:01:56 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.652s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:56 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:56 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:56 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:56 devstack sudo[76058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 16:01:56 devstack sudo[76058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:01:56 devstack sudo[76058]: pam_unix(sudo:session): session closed for user root
Sep 16 16:01:56 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.317s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:56 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:56 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:56 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:56 devstack sudo[76117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 16 16:01:56 devstack sudo[76117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:01:56 devstack sudo[76117]: pam_unix(sudo:session): session closed for user root
Sep 16 16:01:56 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.263s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:56 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:56 devstack sudo[76120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 16:01:56 devstack sudo[76120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:01:57 devstack sudo[76120]: pam_unix(sudo:session): session closed for user root
Sep 16 16:01:57 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:57 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:57 devstack sudo[76129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 16:01:57 devstack sudo[76129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:01:57 devstack sudo[76129]: pam_unix(sudo:session): session closed for user root
Sep 16 16:01:57 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:57 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:57 devstack sudo[76132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 16:01:57 devstack sudo[76132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:01:57 devstack sudo[76132]: pam_unix(sudo:session): session closed for user root
Sep 16 16:01:57 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:57 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:57 devstack sudo[76135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 16:01:57 devstack sudo[76135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:01:57 devstack sudo[76135]: pam_unix(sudo:session): session closed for user root
Sep 16 16:01:57 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:57 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:57 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:57 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:58 devstack sudo[76139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 16:01:58 devstack sudo[76139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:01:58 devstack sudo[76139]: pam_unix(sudo:session): session closed for user root
Sep 16 16:01:58 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:58 devstack cinder-volume[75332]: INFO cinder.volume.drivers.lvm [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 16 16:01:58 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:58 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:58 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:58 devstack sudo[76143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 16:01:58 devstack sudo[76143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:01:58 devstack sudo[76143]: pam_unix(sudo:session): session closed for user root
Sep 16 16:01:58 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:58 devstack cinder-volume[75332]: DEBUG cinder.volume.drivers.lvm [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Updating volume stats {{(pid=75332) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 16 16:01:58 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:58 devstack sudo[76146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 16:01:58 devstack sudo[76146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:01:58 devstack sudo[76146]: pam_unix(sudo:session): session closed for user root
Sep 16 16:01:58 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:58 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:58 devstack sudo[76150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 16:01:58 devstack sudo[76150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:01:59 devstack sudo[76150]: pam_unix(sudo:session): session closed for user root
Sep 16 16:01:59 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:59 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:59 devstack sudo[76155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 16:01:59 devstack sudo[76155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:01:59 devstack sudo[76155]: pam_unix(sudo:session): session closed for user root
Sep 16 16:01:59 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:59 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:59 devstack sudo[76158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 16:01:59 devstack sudo[76158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:01:59 devstack sudo[76158]: pam_unix(sudo:session): session closed for user root
Sep 16 16:01:59 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:01:59 devstack cinder-volume[75332]: INFO cinder.volume.driver [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Driver hasn't implemented _init_vendor_properties()
Sep 16 16:01:59 devstack cinder-volume[75332]: DEBUG cinder.volume.driver [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75332) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 16 16:01:59 devstack cinder-volume[75332]: DEBUG oslo_db.sqlalchemy.engines [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75332) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 16:01:59 devstack cinder-volume[75332]: DEBUG dbcounter [-] [75332] Writer thread running {{(pid=75332) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 16 16:01:59 devstack cinder-volume[75332]: DEBUG cinder.db.api [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Building query based on filter {{(pid=75332) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 16 16:01:59 devstack cinder-volume[75332]: DEBUG cinder.image.image_utils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75332) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 16 16:01:59 devstack cinder-volume[75332]: INFO cinder.keymgr.migration [None req-09761da1-477e-4af4-b251-1cd140651964 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 16 16:01:59 devstack cinder-volume[75332]: DEBUG cinder.volume.drivers.lvm [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Updating volume stats {{(pid=75332) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 16 16:01:59 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:01:59 devstack sudo[76162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 16:01:59 devstack sudo[76162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:02:00 devstack sudo[76162]: pam_unix(sudo:session): session closed for user root
Sep 16 16:02:00 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:02:00 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:02:00 devstack sudo[76167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 16:02:00 devstack sudo[76167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:02:00 devstack sudo[76167]: pam_unix(sudo:session): session closed for user root
Sep 16 16:02:00 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:02:00 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:02:00 devstack sudo[76173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 16:02:00 devstack sudo[76173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:02:00 devstack sudo[76173]: pam_unix(sudo:session): session closed for user root
Sep 16 16:02:00 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:02:00 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:02:00 devstack sudo[76176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 16:02:00 devstack sudo[76176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:02:00 devstack sudo[76176]: pam_unix(sudo:session): session closed for user root
Sep 16 16:02:00 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:02:00 devstack cinder-volume[75332]: DEBUG cinder.manager [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Notifying Schedulers of capabilities ... {{(pid=75332) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:02:00 devstack cinder-volume[75332]: INFO cinder.volume.manager [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Driver initialization completed successfully.
Sep 16 16:02:00 devstack cinder-volume[75332]: INFO cinder.manager [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Initiating service 2 cleanup
Sep 16 16:02:00 devstack cinder-volume[75332]: INFO cinder.manager [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Service 2 cleanup completed.
Sep 16 16:02:00 devstack cinder-volume[75332]: DEBUG cinder.service [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Creating RPC server for service cinder-volume {{(pid=75332) start /opt/stack/cinder/cinder/service.py:231}}
Sep 16 16:02:00 devstack cinder-volume[75332]: DEBUG cinder.service [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75332) start /opt/stack/cinder/cinder/service.py:237}}
Sep 16 16:02:01 devstack cinder-volume[75332]: INFO cinder.volume.manager [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 16 16:02:01 devstack cinder-volume[75332]: DEBUG cinder.volume.drivers.lvm [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Updating volume stats {{(pid=75332) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 16 16:02:01 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:02:01 devstack sudo[76180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 16:02:01 devstack sudo[76180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:02:01 devstack sudo[76180]: pam_unix(sudo:session): session closed for user root
Sep 16 16:02:01 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:02:01 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:02:01 devstack sudo[76183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 16:02:01 devstack sudo[76183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:02:01 devstack sudo[76183]: pam_unix(sudo:session): session closed for user root
Sep 16 16:02:01 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:02:01 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:02:01 devstack sudo[76186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 16:02:01 devstack sudo[76186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:02:01 devstack sudo[76186]: pam_unix(sudo:session): session closed for user root
Sep 16 16:02:01 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:02:01 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:02:01 devstack sudo[76195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 16:02:01 devstack sudo[76195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:02:02 devstack sudo[76195]: pam_unix(sudo:session): session closed for user root
Sep 16 16:02:02 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.321s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:02:02 devstack cinder-volume[75332]: INFO cinder.volume.manager [None req-2ccc310e-44df-436e-b9cd-4f31f235f71f None None] Driver post RPC initialization completed successfully.
Sep 16 16:02:03 devstack cinder-volume[75147]: DEBUG dbcounter [-] [75147] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75147) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:02:12 devstack cinder-volume[75332]: DEBUG dbcounter [-] [75332] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75332) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:02:12 devstack cinder-volume[75332]: DEBUG dbcounter [-] [75332] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75332) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:02:12 devstack cinder-volume[75332]: DEBUG oslo_service.periodic_task [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running periodic task VolumeManager._thread_info {{(pid=75332) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:02:12 devstack cinder-volume[75332]: DEBUG cinder.volume.manager [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] thread count: 6 {{(pid=75332) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:02:12 devstack cinder-volume[75332]: DEBUG cinder.volume.manager [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] thread info: [<_MainThread(MainThread, started 140681803358336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140681693379968)>, <Thread(Thread-3 (stat_writer), started daemon 140681687518976)>, <Thread(Rabbit-heartbeat, started daemon 140681688354368)>, <Thread(Thread-5 (_runner), started daemon 140681688400576)>, <Thread(Thread-7 (_runner), started daemon 140681686451520)>] {{(pid=75332) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:03:12 devstack cinder-volume[75332]: DEBUG oslo_service.periodic_task [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75332) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:03:12 devstack cinder-volume[75332]: DEBUG cinder.volume.drivers.lvm [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Updating volume stats {{(pid=75332) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 16 16:03:12 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:03:12 devstack sudo[78546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 16:03:12 devstack sudo[78546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:03:12 devstack sudo[78546]: pam_unix(sudo:session): session closed for user root
Sep 16 16:03:12 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:03:12 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:03:12 devstack sudo[78551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 16:03:12 devstack sudo[78551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:03:12 devstack sudo[78551]: pam_unix(sudo:session): session closed for user root
Sep 16 16:03:12 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:03:12 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:03:12 devstack sudo[78555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 16:03:12 devstack sudo[78555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:03:13 devstack sudo[78555]: pam_unix(sudo:session): session closed for user root
Sep 16 16:03:13 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:03:13 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:03:13 devstack sudo[78558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 16:03:13 devstack sudo[78558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:03:13 devstack sudo[78558]: pam_unix(sudo:session): session closed for user root
Sep 16 16:03:13 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:03:13 devstack cinder-volume[75332]: DEBUG cinder.manager [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Notifying Schedulers of capabilities ... {{(pid=75332) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:03:13 devstack cinder-volume[75332]: DEBUG oslo_service.periodic_task [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running periodic task VolumeManager._thread_info {{(pid=75332) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:03:13 devstack cinder-volume[75332]: DEBUG cinder.volume.manager [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] thread count: 6 {{(pid=75332) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:03:13 devstack cinder-volume[75332]: DEBUG cinder.volume.manager [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] thread info: [<_MainThread(MainThread, started 140681803358336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140681693379968)>, <Thread(Thread-3 (stat_writer), started daemon 140681687518976)>, <Thread(Rabbit-heartbeat, started daemon 140681688354368)>, <Thread(Thread-5 (_runner), started daemon 140681688400576)>, <Thread(Thread-7 (_runner), started daemon 140681686451520)>] {{(pid=75332) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:04:12 devstack cinder-volume[75332]: DEBUG dbcounter [-] [75332] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75332) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:04:12 devstack cinder-volume[75332]: DEBUG oslo_service.periodic_task [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75332) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:04:12 devstack cinder-volume[75332]: DEBUG cinder.volume.drivers.lvm [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Updating volume stats {{(pid=75332) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 16 16:04:12 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:04:12 devstack sudo[81774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 16:04:12 devstack sudo[81774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:04:12 devstack sudo[81774]: pam_unix(sudo:session): session closed for user root
Sep 16 16:04:12 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:04:12 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:04:12 devstack sudo[81778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 16:04:12 devstack sudo[81778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:04:12 devstack sudo[81778]: pam_unix(sudo:session): session closed for user root
Sep 16 16:04:12 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:04:12 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:04:12 devstack sudo[81781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 16:04:12 devstack sudo[81781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:04:13 devstack sudo[81781]: pam_unix(sudo:session): session closed for user root
Sep 16 16:04:13 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:04:13 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:04:13 devstack sudo[81788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 16:04:13 devstack sudo[81788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:04:13 devstack sudo[81788]: pam_unix(sudo:session): session closed for user root
Sep 16 16:04:13 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:04:13 devstack cinder-volume[75332]: DEBUG cinder.manager [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Notifying Schedulers of capabilities ... {{(pid=75332) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:04:13 devstack cinder-volume[75332]: DEBUG oslo_service.periodic_task [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running periodic task VolumeManager._thread_info {{(pid=75332) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:04:13 devstack cinder-volume[75332]: DEBUG cinder.volume.manager [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] thread count: 6 {{(pid=75332) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:04:13 devstack cinder-volume[75332]: DEBUG cinder.volume.manager [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] thread info: [<_MainThread(MainThread, started 140681803358336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140681693379968)>, <Thread(Thread-3 (stat_writer), started daemon 140681687518976)>, <Thread(Rabbit-heartbeat, started daemon 140681688354368)>, <Thread(Thread-5 (_runner), started daemon 140681688400576)>, <Thread(Thread-7 (_runner), started daemon 140681686451520)>] {{(pid=75332) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:05:12 devstack cinder-volume[75332]: DEBUG oslo_service.periodic_task [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75332) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:05:12 devstack cinder-volume[75332]: DEBUG cinder.volume.drivers.lvm [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Updating volume stats {{(pid=75332) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 16 16:05:12 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:05:12 devstack sudo[83854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 16:05:12 devstack sudo[83854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:05:12 devstack sudo[83854]: pam_unix(sudo:session): session closed for user root
Sep 16 16:05:12 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:05:12 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:05:12 devstack sudo[83857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 16:05:12 devstack sudo[83857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:05:12 devstack sudo[83857]: pam_unix(sudo:session): session closed for user root
Sep 16 16:05:12 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:05:12 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:05:12 devstack sudo[83875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 16:05:12 devstack sudo[83875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:05:13 devstack sudo[83875]: pam_unix(sudo:session): session closed for user root
Sep 16 16:05:13 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:05:13 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:05:13 devstack sudo[83900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 16:05:13 devstack sudo[83900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:05:13 devstack sudo[83900]: pam_unix(sudo:session): session closed for user root
Sep 16 16:05:13 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:05:13 devstack cinder-volume[75332]: DEBUG cinder.manager [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Notifying Schedulers of capabilities ... {{(pid=75332) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:05:13 devstack cinder-volume[75332]: DEBUG oslo_service.periodic_task [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running periodic task VolumeManager._thread_info {{(pid=75332) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:05:13 devstack cinder-volume[75332]: DEBUG cinder.volume.manager [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] thread count: 6 {{(pid=75332) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:05:13 devstack cinder-volume[75332]: DEBUG cinder.volume.manager [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] thread info: [<_MainThread(MainThread, started 140681803358336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140681693379968)>, <Thread(Thread-3 (stat_writer), started daemon 140681687518976)>, <Thread(Rabbit-heartbeat, started daemon 140681688354368)>, <Thread(Thread-5 (_runner), started daemon 140681688400576)>, <Thread(Thread-7 (_runner), started daemon 140681686451520)>] {{(pid=75332) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:06:12 devstack cinder-volume[75332]: DEBUG dbcounter [-] [75332] Writing DB stats cinder:SELECT=1 {{(pid=75332) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:06:12 devstack cinder-volume[75332]: DEBUG dbcounter [-] [75332] Writing DB stats cinder:UPDATE=1 {{(pid=75332) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:06:12 devstack cinder-volume[75332]: DEBUG oslo_service.periodic_task [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75332) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:06:12 devstack cinder-volume[75332]: DEBUG cinder.volume.drivers.lvm [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Updating volume stats {{(pid=75332) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 16 16:06:12 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:06:12 devstack sudo[85201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 16:06:12 devstack sudo[85201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:06:12 devstack sudo[85201]: pam_unix(sudo:session): session closed for user root
Sep 16 16:06:12 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:06:12 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:06:12 devstack sudo[85221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 16:06:12 devstack sudo[85221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:06:12 devstack sudo[85221]: pam_unix(sudo:session): session closed for user root
Sep 16 16:06:12 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:06:12 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:06:12 devstack sudo[85230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 16:06:12 devstack sudo[85230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:06:13 devstack sudo[85230]: pam_unix(sudo:session): session closed for user root
Sep 16 16:06:13 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:06:13 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:06:13 devstack sudo[85250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 16:06:13 devstack sudo[85250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:06:13 devstack sudo[85250]: pam_unix(sudo:session): session closed for user root
Sep 16 16:06:13 devstack cinder-volume[75332]: DEBUG oslo_concurrency.processutils [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75332) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:06:13 devstack cinder-volume[75332]: DEBUG cinder.manager [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Notifying Schedulers of capabilities ... {{(pid=75332) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:06:13 devstack cinder-volume[75332]: DEBUG oslo_service.periodic_task [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] Running periodic task VolumeManager._thread_info {{(pid=75332) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:06:13 devstack cinder-volume[75332]: DEBUG cinder.volume.manager [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] thread count: 6 {{(pid=75332) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:06:13 devstack cinder-volume[75332]: DEBUG cinder.volume.manager [None req-596d962d-2725-410f-9c1c-1b8d1d8f05cb None None] thread info: [<_MainThread(MainThread, started 140681803358336)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140681693379968)>, <Thread(Thread-3 (stat_writer), started daemon 140681687518976)>, <Thread(Rabbit-heartbeat, started daemon 140681688354368)>, <Thread(Thread-5 (_runner), started daemon 140681688400576)>, <Thread(Thread-7 (_runner), started daemon 140681686451520)>] {{(pid=75332) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:06:14 devstack cinder-volume[75147]: INFO oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Caught SIGTERM, stopping children
Sep 16 16:06:14 devstack cinder-volume[75147]: DEBUG oslo_concurrency.lockutils [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Acquiring lock "singleton_lock" {{(pid=75147) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 16 16:06:14 devstack cinder-volume[75147]: DEBUG oslo_concurrency.lockutils [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Acquired lock "singleton_lock" {{(pid=75147) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 16 16:06:14 devstack cinder-volume[75147]: DEBUG oslo_concurrency.lockutils [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Releasing lock "singleton_lock" {{(pid=75147) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 16 16:06:14 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Stop services. {{(pid=75147) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 16 16:06:14 devstack cinder-volume[75147]: DEBUG oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Killing children. {{(pid=75147) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 16 16:06:14 devstack cinder-volume[75147]: INFO oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Waiting on 1 children to exit
Sep 16 16:06:16 devstack cinder-volume[75332]: DEBUG oslo_concurrency.lockutils [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Acquiring lock "singleton_lock" {{(pid=75332) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 16 16:06:16 devstack cinder-volume[75332]: DEBUG oslo_concurrency.lockutils [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Acquired lock "singleton_lock" {{(pid=75332) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 16 16:06:16 devstack cinder-volume[75332]: DEBUG oslo_concurrency.lockutils [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Releasing lock "singleton_lock" {{(pid=75332) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 16 16:06:16 devstack cinder-volume[75332]: WARNING amqp [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 16 16:06:16 devstack cinder-volume[75332]: WARNING amqp [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 16 16:06:16 devstack cinder-volume[75147]: INFO oslo_service.backend._eventlet.service [None req-b0a9c8c3-f09d-405e-bc60-5d6af4916ee4 None None] Child 75332 exited with status 0
Sep 16 16:06:16 devstack cinder-volume[85336]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 16 16:06:16 devstack cinder-volume[85336]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 16 16:06:16 devstack cinder-volume[85336]: we strongly recommend against using it for new projects.
Sep 16 16:06:16 devstack cinder-volume[85336]: If you are already using Eventlet, we recommend migrating to a different
Sep 16 16:06:16 devstack cinder-volume[85336]: framework.  For more detail see
Sep 16 16:06:16 devstack cinder-volume[85336]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 16 16:06:16 devstack cinder-volume[85336]:   import eventlet  # noqa
Sep 16 16:06:18 devstack cinder-volume[85336]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85336) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 16 16:06:18 devstack cinder-volume[85336]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85336) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 16 16:06:18 devstack cinder-volume[85336]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85336) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 16 16:06:19 devstack cinder-volume[85336]: INFO dbcounter [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Registered counter for database cinder
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_db.sqlalchemy.engines [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85336) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG dbcounter [-] [85336] Writer thread running {{(pid=85336) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 16 16:06:19 devstack cinder-volume[85336]: INFO cinder.rpc [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 16 16:06:19 devstack cinder-volume[85336]: INFO cinder.rpc [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_db.sqlalchemy.engines [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85336) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 16:06:19 devstack cinder-volume[85336]: INFO cinder.volume.manager [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Determined volume DB was empty at startup.
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG cinder.volume.manager [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85336) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 16 16:06:19 devstack cinder-volume[85336]: INFO cinder.volume.manager [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 16 16:06:19 devstack cinder-volume[85336]: WARNING stevedore.named [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 16 16:06:19 devstack cinder-volume[85336]: WARNING castellan.key_manager [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 16:06:19 devstack cinder-volume[85336]: WARNING cinder.keymgr.conf_key_mgr [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 16:06:19 devstack cinder-volume[85336]: INFO cinder.volume.manager [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_db.sqlalchemy.engines [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85336) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 16:06:19 devstack cinder-volume[85336]: INFO oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Starting 1 workers
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Started child 85552 {{(pid=85336) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Full set of CONF: {{(pid=85336) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] ******************************************************************************** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Configuration options gathered from: {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] ================================================================================ {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] allow_availability_zone_fallback = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] allow_compression_on_image_upload = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] allowed_direct_url_schemes     = [] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85552]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] api_rate_limit                 = True {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] auth_strategy                  = keystone {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_availability_zone      = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_host                   = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_name                   = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_stats_polling_interval = 60 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backup_api_class               = cinder.backup.api.API {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backup_name_template           = backup-%s {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backup_use_same_host           = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backup_use_temp_snapshot       = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] chap_password                  = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] chap_username                  =  {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cinder_internal_tenant_project_id = 9f8fd6342eba499cb62787127d5fef23 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cinder_internal_tenant_user_id = 5bdcb0849c4649b49c76bcb1e14f7f00 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cluster                        = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] compression_format             = gzip {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] compute_api_class              = cinder.compute.nova.API {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] config_dir                     = [] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] config_source                  = [] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] control_exchange               = openstack {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] debug                          = True {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] default_availability_zone      = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] default_group_type             = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] default_volume_type            = QuobyteHD {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] disk_geometry                  = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] driver_client_cert             = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] driver_client_cert_key         = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] driver_data_namespace          = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] driver_ssl_cert_path           = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] driver_ssl_cert_verify         = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] driver_use_ssl                 = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] enable_new_services            = True {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] enable_unsupported_driver      = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] enabled_backends               = ['QuobyteHD'] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] enforce_multipath_for_image_xfer = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] filter_function                = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] glance_api_insecure            = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] glance_api_servers             = ['http://192.168.122.127/image'] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] glance_api_ssl_compression     = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] glance_ca_certificates_file    = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] glance_catalog_info            = image:glance:publicURL {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] glance_certfile                = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] glance_keyfile                 = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] glance_num_retries             = 3 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] glance_request_timeout         = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] goodness_function              = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] graceful_shutdown_timeout      = 5 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] group_api_class                = cinder.group.api.API {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] host                           = devstack {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] image_compress_on_upload       = True {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] image_conversion_address_space_limit = 1 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] image_conversion_cpu_limit     = 60 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] image_conversion_disable       = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] image_introspection_address_space_limit = 1 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] image_introspection_cpu_limit  = 60 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] image_upload_use_cinder_backend = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] image_upload_use_internal_tenant = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] image_volume_cache_enabled     = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] image_volume_cache_max_count   = 0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] image_volume_cache_max_size_gb = 0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] init_host_max_objects_retrieval = 0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] instance_format                = [instance: %(uuid)s]  {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] iscsi_target_flags             =  {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] iscsi_write_cache              = on {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] iser_helper                    = tgtadm {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] iser_ip_address                = 192.168.122.127 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] iser_port                      = 3260 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] log_color                      = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] log_config_append              = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85552]: INFO cinder.volume.manager [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 16 16:06:19 devstack cinder-volume[85552]: DEBUG cinder.volume.drivers.remotefs [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85552) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] log_dir                        = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] log_file                       = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] log_options                    = True {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] log_rotate_interval            = 1 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] log_rotate_interval_type       = days {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] log_rotation_type              = none {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] max_age                        = 0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] max_logfile_count              = 30 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] max_logfile_size_mb            = 200 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] max_over_subscription_ratio    = 20.0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] message_reap_interval          = 86400 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] message_ttl                    = 2592000 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] migration_create_volume_timeout_secs = 300 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] monkey_patch                   = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] monkey_patch_modules           = [] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] my_ip                          = 192.168.122.127 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] no_snapshot_gb_quota           = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] num_iser_scan_tries            = 3 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] num_shell_tries                = 3 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] num_volume_device_scan_tries   = 3 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] nvmeof_conn_info_version       = 1 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] nvmet_ns_id                    = 10 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] nvmet_port_id                  = 1 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] osapi_max_limit                = 1000 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] osapi_volume_ext_list          = [] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] osapi_volume_listen_port       = 8776 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] osapi_volume_use_ssl           = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] osapi_volume_workers           = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] per_volume_size_limit          = -1 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] periodic_fuzzy_delay           = 60 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] periodic_interval              = 60 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] public_endpoint                = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] publish_errors                 = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] quota_backup_gigabytes         = 1000 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] quota_backups                  = 10 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] quota_gigabytes                = 1000 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] quota_groups                   = 10 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] quota_snapshots                = 10 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] quota_volumes                  = 10 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] rate_limit_burst               = 0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] rate_limit_except_level        = CRITICAL {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] rate_limit_interval            = 0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] reinit_driver_count            = 3 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] replication_device             = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] report_discard_supported       = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] report_interval                = 120 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] reservation_clean_interval     = 86400 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] reservation_expire             = 86400 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] reserved_image_namespaces      = [] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] reserved_percentage            = 0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] rpc_response_timeout           = 120 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] run_external_periodic_tasks    = True {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] scst_target_driver             = iscsi {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] scst_target_iqn_name           = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] service_down_time              = 720 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] shell_completion               = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] snapshot_name_template         = snapshot-%s {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] split_loggers                  = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] state_path                     = /opt/stack/data/cinder {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] storage_availability_zone      = nova {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] storage_protocol               = iSCSI {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] syslog_log_facility            = LOG_USER {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] target_helper                  = lioadm {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] target_ip_address              = 192.168.122.127 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] target_port                    = 3260 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] target_protocol                = iscsi {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] target_secondary_ip_addresses  = [] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] trace_flags                    = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] transport_url                  = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] until_refresh                  = 0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] use_chap_auth                  = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] use_default_quota_class        = True {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] use_journal                    = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] use_json                       = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] use_multipath_for_image_xfer   = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] use_stderr                     = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] use_syslog                     = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] verify_glance_signatures       = enabled {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] volume_api_class               = cinder.volume.api.API {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] volume_backend_name            = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] volume_clear                   = zero {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] volume_clear_ionice            = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] volume_clear_size              = 0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] volume_copy_bps_limit          = 0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] volume_dd_blocksize            = 1M {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] volume_name_template           = volume-%s {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] volume_service_inithost_offload = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] volume_usage_audit_period      = month {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] zoning_mode                    = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_concurrency.disable_process_locking = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.auth_section = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.auth_type   = password {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.auth_version = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.cache       = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.certfile    = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.include_service_catalog = True {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.insecure    = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.interface   = public {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.keyfile     = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.memcache_password = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.memcache_username = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.region_name = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.service_type = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.127/identity {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.backend                  = dogpile.cache.null {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.backend_argument         = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.backend_expiration_time  = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.config_prefix            = cache.oslo {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.debug_cache_backend      = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.enable_retry_client      = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85552]: DEBUG cinder.volume.drivers.quobyte [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85552) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 16 16:06:19 devstack cinder-volume[85552]: WARNING cinder.volume.drivers.quobyte [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.enable_socket_keepalive  = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.enabled                  = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85552]: WARNING cinder.volume.drivers.quobyte [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.expiration_time          = 600 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.hashclient_retry_attempts = 2 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.memcache_dead_retry      = 300 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.memcache_pool_maxsize    = 10 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.memcache_sasl_enabled    = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85552]: DEBUG oslo_concurrency.processutils [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Running cmd (subprocess): mount.quobyte {{(pid=85552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.password                 = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.proxies                  = [] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.redis_db                 = 0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.redis_server             = localhost:6379 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.retry_attempts           = 2 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.retry_delay              = 0.0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.socket_keepalive_count   = 1 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.socket_keepalive_idle    = 1 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.socket_keepalive_interval = 1 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.socket_timeout           = 1.0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.tls_allowed_ciphers      = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.tls_cafile               = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.tls_certfile             = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.tls_enabled              = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.tls_keyfile              = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cache.username                 = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] coordination.backend_url       = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.asyncio_connection    = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.asyncio_slave_connection = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.backend               = sqlalchemy {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.connection            = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.connection_debug      = 0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.connection_parameters =  {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.connection_recycle_time = 3600 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.connection_trace      = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.db_inc_retry_interval = True {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.db_max_retries        = 20 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.db_max_retry_interval = 10 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.db_retry_interval     = 1 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.max_overflow          = 50 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.max_pool_size         = 5 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.max_retries           = 10 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.mysql_wsrep_sync_wait = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.pool_timeout          = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.retry_interval        = 10 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.slave_connection      = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.sqlite_synchronous    = True {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.synchronous_reader    = True {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] database.use_db_reconnect      = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_tracing.insecure = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] profiler.connection_string     = messaging:// {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] profiler.enabled               = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] profiler.es_doc_type           = notification {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] profiler.es_scroll_size        = 10000 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] profiler.es_scroll_time        = 2m {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] profiler.filter_error_trace    = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] profiler.hmac_keys             = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] profiler.sentinel_service_name = mymaster {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] profiler.socket_timeout        = 0.1 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] profiler.trace_requests        = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] profiler.trace_sqlalchemy      = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] profiler_jaeger.process_tags   = {} {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] profiler_jaeger.service_name_prefix = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] profiler_otlp.service_name_prefix = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_policy.enforce_new_defaults = True {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_policy.policy_default_rule = default {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_policy.policy_file        = policy.yaml {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] privsep_osbrick.group          = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] privsep_osbrick.helper_command = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] privsep_osbrick.user           = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cinder_sys_admin.group         = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cinder_sys_admin.helper_command = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] cinder_sys_admin.user          = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] service_user.auth_section      = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] service_user.auth_type         = password {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] service_user.cafile            = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] service_user.certfile          = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] service_user.collect_timing    = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] service_user.insecure          = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] service_user.keyfile           = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] service_user.send_service_user_token = True {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] service_user.split_loggers     = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] service_user.timeout           = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] service_user.tls_ciphers       = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] service_user.tls_min_version   = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] glance.auth_section            = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] glance.auth_type               = password {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] glance.certfile                = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] glance.collect_timing          = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] glance.insecure                = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] glance.keyfile                 = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] glance.region_name             = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] glance.split_loggers           = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] glance.timeout                 = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] glance.tls_ciphers             = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] glance.tls_min_version         = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.backend_availability_zone = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.chap_password = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.chap_username =  {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.disk_geometry = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.driver_client_cert = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.driver_client_cert_key = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.driver_data_namespace = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.driver_use_ssl = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.extra_capabilities = {} {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.filter_function = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.goodness_function = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.iscsi_target_flags =  {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.iscsi_write_cache = on {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.iser_helper   = tgtadm {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.iser_ip_address = 192.168.122.127 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.iser_port     = 3260 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.nas_host      =  {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.nas_login     = admin {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.nas_mount_options = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.nas_password  = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:19 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.nas_private_key =  {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.nas_share_path =  {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.num_shell_tries = 3 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack quobyte-client[85554]: Reading configuration file: /etc/quobyte/client.cfg
Sep 16 16:06:20 devstack quobyte-client[85554]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 16 16:06:20 devstack cinder-volume[85552]: DEBUG oslo_concurrency.processutils [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] CMD "mount.quobyte" returned: 1 in 0.125s {{(pid=85552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:06:20 devstack cinder-volume[85552]: DEBUG oslo_concurrency.lockutils [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:06:20 devstack cinder-volume[85552]: DEBUG oslo_concurrency.lockutils [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:06:20 devstack cinder-volume[85552]: DEBUG cinder.volume.drivers.quobyte [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=85552) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:06:20 devstack cinder-volume[85552]: INFO cinder.volume.drivers.quobyte [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 ...
Sep 16 16:06:20 devstack cinder-volume[85552]: DEBUG oslo_concurrency.processutils [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 -c /etc/quobyte/client-cinder.cfg {{(pid=85552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.quobyte_volume_url = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.replication_device = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.report_discard_supported = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.reserved_percentage = 0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.target_helper = tgtadm {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.target_ip_address = 192.168.122.127 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.target_port   = 3260 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.target_protocol = iscsi {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.trace_flags   = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.unique_fqdn_network = True {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.use_chap_auth = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.volume_backend_name = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.volume_clear  = zero {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.volume_clear_ionice = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.volume_clear_size = 0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_reports.file_event_handler = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_reports.log_dir           = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.backend_availability_zone = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.backend_host         = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.chap_password        = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.chap_username        = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.chiscsi_conf         = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.disk_geometry        = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.driver_client_cert   = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.driver_data_namespace = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack sudo[85557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 -c /etc/quobyte/client-cinder.cfg
Sep 16 16:06:20 devstack sudo[85557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.driver_use_ssl       = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.extra_capabilities   = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.filter_function      = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.goodness_function    = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.iser_helper          = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.iser_ip_address      = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.iser_port            = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.iser_target_prefix   = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.nas_host             = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.nas_login            = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.nas_mount_options    = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.nas_password         = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.nas_private_key      = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.nas_share_path       = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.nas_ssh_port         = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.num_shell_tries      = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.nvmet_port_id        = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.replication_device   = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.report_discard_supported = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.reserved_percentage  = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.scst_target_driver   = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.storage_protocol     = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.target_helper        = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.target_ip_address    = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.target_port          = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.target_prefix        = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.target_protocol      = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.trace_flags          = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.use_chap_auth        = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.volume_clear         = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.volume_clear_size    = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] QuobyteHD.volumes_dir          = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.ssl      = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_notifications.driver = [] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_notifications.retry = -1 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] key_manager.fixed_key          = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican.barbican_api_version  = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican.barbican_endpoint     = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican.barbican_endpoint_type = public {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican.barbican_region_name  = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican.cafile                = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican.certfile              = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican.collect_timing        = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican.insecure              = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican.keyfile               = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican.number_of_retries     = 60 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican.retry_delay           = 1 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican.send_service_user_token = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican.split_loggers         = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican.timeout               = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican.tls_ciphers           = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican.tls_min_version       = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican.verify_ssl            = True {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican.verify_ssl_path       = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican_service_user.auth_section = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican_service_user.auth_type = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican_service_user.cafile   = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican_service_user.certfile = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican_service_user.collect_timing = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican_service_user.insecure = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican_service_user.keyfile  = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican_service_user.split_loggers = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican_service_user.timeout  = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican_service_user.tls_ciphers = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] barbican_service_user.tls_min_version = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] vault.approle_role_id          = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] vault.approle_secret_id        = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] vault.auth_method              = approle {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] vault.auth_path                = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] vault.kv_mountpoint            = secret {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] vault.kv_path                  = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] vault.kv_version               = 2 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] vault.namespace                = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] vault.root_token_id            = **** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] vault.ssl_ca_crt_file          = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] vault.timeout                  = 60.0 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] vault.token_file               = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] vault.token_role               = None {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] vault.use_ssl                  = False {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:20 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] ******************************************************************************** {{(pid=85336) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 16 16:06:20 devstack sudo[85557]: pam_unix(sudo:session): session closed for user root
Sep 16 16:06:20 devstack cinder-volume[85552]: DEBUG oslo_concurrency.processutils [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.434s {{(pid=85552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:06:20 devstack cinder-volume[85552]: INFO cinder.volume.drivers.quobyte [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 succeeded
Sep 16 16:06:20 devstack cinder-volume[85552]: DEBUG cinder.volume.drivers.quobyte [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=85552) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:06:20 devstack cinder-volume[85552]: DEBUG oslo_concurrency.lockutils [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.470s {{(pid=85552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:06:20 devstack cinder-volume[85552]: DEBUG oslo_concurrency.processutils [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=85552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:06:20 devstack sudo[85658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:06:20 devstack sudo[85658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:06:20 devstack sudo[85658]: pam_unix(sudo:session): session closed for user root
Sep 16 16:06:20 devstack cinder-volume[85552]: DEBUG oslo_concurrency.processutils [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.227s {{(pid=85552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:06:20 devstack cinder-volume[85552]: INFO cinder.volume.driver [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Driver hasn't implemented _init_vendor_properties()
Sep 16 16:06:20 devstack cinder-volume[85552]: DEBUG cinder.volume.driver [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.9149932861328, 'free_capacity_gb': 1775.9149932861328, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85552) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 16 16:06:20 devstack cinder-volume[85552]: DEBUG oslo_db.sqlalchemy.engines [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85552) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 16:06:20 devstack cinder-volume[85552]: DEBUG dbcounter [-] [85552] Writer thread running {{(pid=85552) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 16 16:06:20 devstack cinder-volume[85552]: DEBUG cinder.db.api [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Building query based on filter {{(pid=85552) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 16 16:06:20 devstack cinder-volume[85552]: DEBUG cinder.image.image_utils [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85552) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 16 16:06:20 devstack cinder-volume[85552]: INFO cinder.keymgr.migration [None req-0b9c8157-2cbd-496d-a944-a9bb2914334c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 16 16:06:20 devstack cinder-volume[85552]: DEBUG oslo_concurrency.lockutils [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:06:20 devstack cinder-volume[85552]: DEBUG oslo_concurrency.lockutils [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:06:20 devstack cinder-volume[85552]: DEBUG cinder.volume.drivers.quobyte [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=85552) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:06:20 devstack cinder-volume[85552]: DEBUG cinder.volume.drivers.quobyte [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=85552) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:06:20 devstack cinder-volume[85552]: DEBUG oslo_concurrency.lockutils [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:06:20 devstack cinder-volume[85552]: DEBUG oslo_concurrency.processutils [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=85552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:06:20 devstack sudo[85661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:06:20 devstack sudo[85661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:06:21 devstack sudo[85661]: pam_unix(sudo:session): session closed for user root
Sep 16 16:06:21 devstack cinder-volume[85552]: DEBUG oslo_concurrency.processutils [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.240s {{(pid=85552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:06:21 devstack cinder-volume[85552]: DEBUG cinder.manager [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Notifying Schedulers of capabilities ... {{(pid=85552) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:06:21 devstack cinder-volume[85552]: INFO cinder.volume.manager [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Driver initialization completed successfully.
Sep 16 16:06:21 devstack cinder-volume[85552]: INFO cinder.manager [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Initiating service 3 cleanup
Sep 16 16:06:21 devstack cinder-volume[85552]: INFO cinder.manager [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Service 3 cleanup completed.
Sep 16 16:06:21 devstack cinder-volume[85552]: DEBUG cinder.service [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Creating RPC server for service cinder-volume {{(pid=85552) start /opt/stack/cinder/cinder/service.py:231}}
Sep 16 16:06:21 devstack cinder-volume[85552]: DEBUG cinder.service [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85552) start /opt/stack/cinder/cinder/service.py:237}}
Sep 16 16:06:21 devstack cinder-volume[85552]: INFO cinder.volume.manager [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 16 16:06:21 devstack cinder-volume[85552]: DEBUG oslo_concurrency.lockutils [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:06:21 devstack cinder-volume[85552]: DEBUG oslo_concurrency.lockutils [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:06:21 devstack cinder-volume[85552]: DEBUG cinder.volume.drivers.quobyte [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=85552) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:06:21 devstack cinder-volume[85552]: DEBUG cinder.volume.drivers.quobyte [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=85552) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:06:21 devstack cinder-volume[85552]: DEBUG oslo_concurrency.lockutils [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:06:21 devstack cinder-volume[85552]: DEBUG oslo_concurrency.processutils [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=85552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:06:21 devstack sudo[85664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:06:21 devstack sudo[85664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:06:21 devstack sudo[85664]: pam_unix(sudo:session): session closed for user root
Sep 16 16:06:21 devstack cinder-volume[85552]: DEBUG oslo_concurrency.processutils [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.244s {{(pid=85552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:06:21 devstack cinder-volume[85552]: INFO cinder.volume.manager [None req-e1cd66ce-ab02-4db9-ba1d-7e7c2578647f None None] Driver post RPC initialization completed successfully.
Sep 16 16:06:25 devstack cinder-volume[85552]: DEBUG oslo_concurrency.lockutils [None req-ae435bde-6ae9-4ceb-a769-1cb7127299cc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:06:25 devstack cinder-volume[85552]: DEBUG oslo_concurrency.lockutils [None req-ae435bde-6ae9-4ceb-a769-1cb7127299cc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:06:25 devstack cinder-volume[85552]: DEBUG cinder.volume.drivers.quobyte [None req-ae435bde-6ae9-4ceb-a769-1cb7127299cc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=85552) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:06:25 devstack cinder-volume[85552]: DEBUG cinder.volume.drivers.quobyte [None req-ae435bde-6ae9-4ceb-a769-1cb7127299cc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=85552) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:06:25 devstack cinder-volume[85552]: DEBUG oslo_concurrency.lockutils [None req-ae435bde-6ae9-4ceb-a769-1cb7127299cc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85552) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:06:25 devstack cinder-volume[85552]: DEBUG oslo_concurrency.processutils [None req-ae435bde-6ae9-4ceb-a769-1cb7127299cc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=85552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:06:25 devstack sudo[85782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:06:25 devstack sudo[85782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:06:26 devstack sudo[85782]: pam_unix(sudo:session): session closed for user root
Sep 16 16:06:26 devstack cinder-volume[85552]: DEBUG oslo_concurrency.processutils [None req-ae435bde-6ae9-4ceb-a769-1cb7127299cc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.223s {{(pid=85552) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:06:26 devstack cinder-volume[85552]: DEBUG cinder.manager [None req-ae435bde-6ae9-4ceb-a769-1cb7127299cc None None] Notifying Schedulers of capabilities ... {{(pid=85552) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:06:29 devstack cinder-volume[85336]: INFO oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Caught SIGTERM, stopping children
Sep 16 16:06:29 devstack cinder-volume[85336]: DEBUG oslo_concurrency.lockutils [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Acquiring lock "singleton_lock" {{(pid=85336) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 16 16:06:29 devstack cinder-volume[85336]: DEBUG oslo_concurrency.lockutils [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Acquired lock "singleton_lock" {{(pid=85336) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 16 16:06:29 devstack cinder-volume[85336]: DEBUG oslo_concurrency.lockutils [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Releasing lock "singleton_lock" {{(pid=85336) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 16 16:06:29 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Stop services. {{(pid=85336) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 16 16:06:29 devstack cinder-volume[85336]: DEBUG oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Killing children. {{(pid=85336) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 16 16:06:29 devstack cinder-volume[85336]: INFO oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Waiting on 1 children to exit
Sep 16 16:06:31 devstack cinder-volume[85552]: DEBUG dbcounter [-] [85552] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85552) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:06:31 devstack cinder-volume[85552]: DEBUG dbcounter [-] [85552] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=85552) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:06:34 devstack cinder-volume[85552]: DEBUG oslo_concurrency.lockutils [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Acquiring lock "singleton_lock" {{(pid=85552) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 16 16:06:34 devstack cinder-volume[85552]: DEBUG oslo_concurrency.lockutils [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Acquired lock "singleton_lock" {{(pid=85552) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 16 16:06:34 devstack cinder-volume[85552]: DEBUG oslo_concurrency.lockutils [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Releasing lock "singleton_lock" {{(pid=85552) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 16 16:06:34 devstack cinder-volume[85552]: WARNING amqp [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 16 16:06:34 devstack cinder-volume[85552]: WARNING amqp [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 16 16:06:34 devstack cinder-volume[85336]: INFO oslo_service.backend._eventlet.service [None req-2b27da47-dd18-4fb0-8c8d-a96200d85ce7 None None] Child 85552 exited with status 0
Sep 16 16:06:35 devstack cinder-volume[85887]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 16 16:06:35 devstack cinder-volume[85887]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 16 16:06:35 devstack cinder-volume[85887]: we strongly recommend against using it for new projects.
Sep 16 16:06:35 devstack cinder-volume[85887]: If you are already using Eventlet, we recommend migrating to a different
Sep 16 16:06:35 devstack cinder-volume[85887]: framework.  For more detail see
Sep 16 16:06:35 devstack cinder-volume[85887]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 16 16:06:35 devstack cinder-volume[85887]:   import eventlet  # noqa
Sep 16 16:06:37 devstack cinder-volume[85887]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85887) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 16 16:06:37 devstack cinder-volume[85887]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85887) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 16 16:06:37 devstack cinder-volume[85887]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85887) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 16 16:06:38 devstack cinder-volume[85887]: INFO dbcounter [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] Registered counter for database cinder
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_db.sqlalchemy.engines [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85887) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG dbcounter [-] [85887] Writer thread running {{(pid=85887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 16 16:06:38 devstack cinder-volume[85887]: INFO cinder.rpc [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 16 16:06:38 devstack cinder-volume[85887]: INFO cinder.rpc [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_db.sqlalchemy.engines [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85887) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 16:06:38 devstack cinder-volume[85887]: INFO cinder.volume.manager [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] Determined volume DB was empty at startup.
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG cinder.volume.manager [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85887) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 16 16:06:38 devstack cinder-volume[85887]: WARNING stevedore.named [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 16 16:06:38 devstack cinder-volume[85887]: WARNING castellan.key_manager [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 16:06:38 devstack cinder-volume[85887]: WARNING cinder.keymgr.conf_key_mgr [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 16:06:38 devstack cinder-volume[85887]: INFO cinder.volume.manager [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_db.sqlalchemy.engines [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85887) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 16:06:38 devstack cinder-volume[85887]: INFO oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] Starting 1 workers
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] Started child 86165 {{(pid=85887) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 16 16:06:38 devstack cinder-volume[86165]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] Full set of CONF: {{(pid=85887) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] ******************************************************************************** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] Configuration options gathered from: {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] ================================================================================ {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] allow_availability_zone_fallback = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] allow_compression_on_image_upload = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] allowed_direct_url_schemes     = [] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] api_rate_limit                 = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] auth_strategy                  = keystone {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_availability_zone      = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_host                   = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_name                   = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_stats_polling_interval = 60 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backup_api_class               = cinder.backup.api.API {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backup_name_template           = backup-%s {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backup_use_same_host           = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backup_use_temp_snapshot       = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] chap_password                  = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] chap_username                  =  {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cinder_internal_tenant_project_id = 9f8fd6342eba499cb62787127d5fef23 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cinder_internal_tenant_user_id = 5bdcb0849c4649b49c76bcb1e14f7f00 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cluster                        = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] compression_format             = gzip {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] compute_api_class              = cinder.compute.nova.API {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] config_dir                     = [] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] config_source                  = [] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] control_exchange               = openstack {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] debug                          = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] default_availability_zone      = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] default_group_type             = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] default_volume_type            = QuobyteHD {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] disk_geometry                  = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] driver_client_cert             = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] driver_client_cert_key         = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] driver_data_namespace          = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] driver_ssl_cert_path           = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] driver_ssl_cert_verify         = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] driver_use_ssl                 = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] enable_new_services            = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] enable_unsupported_driver      = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] enabled_backends               = ['QuobyteHD'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] enforce_multipath_for_image_xfer = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] filter_function                = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] glance_api_insecure            = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] glance_api_servers             = ['http://192.168.122.127/image'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] glance_api_ssl_compression     = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] glance_ca_certificates_file    = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] glance_catalog_info            = image:glance:publicURL {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] glance_certfile                = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] glance_keyfile                 = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] glance_num_retries             = 3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] glance_request_timeout         = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] goodness_function              = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] graceful_shutdown_timeout      = 5 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] group_api_class                = cinder.group.api.API {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] host                           = devstack {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] image_compress_on_upload       = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] image_conversion_address_space_limit = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] image_conversion_cpu_limit     = 60 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] image_conversion_disable       = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] image_introspection_address_space_limit = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] image_introspection_cpu_limit  = 60 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] image_upload_use_cinder_backend = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] image_upload_use_internal_tenant = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86165) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] image_volume_cache_enabled     = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] image_volume_cache_max_count   = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] image_volume_cache_max_size_gb = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] init_host_max_objects_retrieval = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] iscsi_target_flags             =  {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] iscsi_write_cache              = on {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] iser_helper                    = tgtadm {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] iser_ip_address                = 192.168.122.127 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] iser_port                      = 3260 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] log_color                      = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] log_config_append              = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] log_dir                        = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] log_file                       = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] log_options                    = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] log_rotate_interval            = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] log_rotate_interval_type       = days {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] log_rotation_type              = none {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] max_age                        = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] max_logfile_count              = 30 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] max_logfile_size_mb            = 200 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] max_over_subscription_ratio    = 20.0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] message_reap_interval          = 86400 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] message_ttl                    = 2592000 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] migration_create_volume_timeout_secs = 300 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] monkey_patch                   = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] monkey_patch_modules           = [] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] my_ip                          = 192.168.122.127 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] no_snapshot_gb_quota           = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] num_iser_scan_tries            = 3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] num_shell_tries                = 3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] num_volume_device_scan_tries   = 3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] nvmeof_conn_info_version       = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] nvmet_ns_id                    = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] nvmet_port_id                  = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] osapi_max_limit                = 1000 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] osapi_volume_ext_list          = [] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] osapi_volume_listen_port       = 8776 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] osapi_volume_use_ssl           = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] osapi_volume_workers           = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] per_volume_size_limit          = -1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] periodic_fuzzy_delay           = 60 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] periodic_interval              = 60 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] public_endpoint                = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] publish_errors                 = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] quota_backup_gigabytes         = 1000 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] quota_backups                  = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] quota_gigabytes                = 1000 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] quota_groups                   = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] quota_snapshots                = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] quota_volumes                  = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] rate_limit_burst               = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] rate_limit_except_level        = CRITICAL {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] rate_limit_interval            = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] reinit_driver_count            = 3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] replication_device             = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] report_discard_supported       = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] report_interval                = 120 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] reservation_clean_interval     = 86400 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] reservation_expire             = 86400 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] reserved_image_namespaces      = [] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] reserved_percentage            = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] rpc_response_timeout           = 120 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] run_external_periodic_tasks    = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] scst_target_driver             = iscsi {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] scst_target_iqn_name           = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] service_down_time              = 720 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] shell_completion               = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] snapshot_name_template         = snapshot-%s {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] split_loggers                  = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] state_path                     = /opt/stack/data/cinder {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] storage_availability_zone      = nova {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] storage_protocol               = iSCSI {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] syslog_log_facility            = LOG_USER {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] target_helper                  = lioadm {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] target_ip_address              = 192.168.122.127 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] target_port                    = 3260 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] target_protocol                = iscsi {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] target_secondary_ip_addresses  = [] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] trace_flags                    = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] transport_url                  = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] until_refresh                  = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] use_chap_auth                  = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] use_default_quota_class        = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] use_journal                    = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] use_json                       = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] use_multipath_for_image_xfer   = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] use_stderr                     = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] use_syslog                     = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] verify_glance_signatures       = enabled {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] volume_api_class               = cinder.volume.api.API {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] volume_backend_name            = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] volume_clear                   = zero {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] volume_clear_ionice            = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] volume_clear_size              = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] volume_copy_bps_limit          = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] volume_dd_blocksize            = 1M {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] volume_name_template           = volume-%s {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] volume_service_inithost_offload = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] volume_usage_audit_period      = month {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] zoning_mode                    = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_concurrency.disable_process_locking = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.auth_section = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.auth_type   = password {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.auth_version = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.cache       = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.certfile    = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.include_service_catalog = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.insecure    = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.interface   = public {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.keyfile     = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.memcache_password = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.memcache_username = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.region_name = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.service_type = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.127/identity {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.backend                  = dogpile.cache.null {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.backend_argument         = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.backend_expiration_time  = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.config_prefix            = cache.oslo {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.debug_cache_backend      = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.enable_retry_client      = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.enable_socket_keepalive  = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.enabled                  = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.expiration_time          = 600 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.hashclient_retry_attempts = 2 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.memcache_dead_retry      = 300 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.memcache_sasl_enabled    = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.password                 = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.proxies                  = [] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.redis_db                 = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.redis_server             = localhost:6379 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.retry_attempts           = 2 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.retry_delay              = 0.0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.socket_keepalive_count   = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.socket_keepalive_idle    = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.socket_keepalive_interval = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.socket_timeout           = 1.0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.tls_allowed_ciphers      = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.tls_cafile               = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.tls_certfile             = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.tls_enabled              = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.tls_keyfile              = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cache.username                 = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] coordination.backend_url       = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.asyncio_connection    = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.asyncio_slave_connection = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.backend               = sqlalchemy {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.connection            = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.connection_debug      = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.connection_parameters =  {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.connection_recycle_time = 3600 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.connection_trace      = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.db_inc_retry_interval = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.db_max_retries        = 20 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.db_max_retry_interval = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.db_retry_interval     = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.max_overflow          = 50 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.max_pool_size         = 5 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.max_retries           = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.mysql_wsrep_sync_wait = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.pool_timeout          = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.retry_interval        = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.slave_connection      = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.sqlite_synchronous    = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.synchronous_reader    = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] database.use_db_reconnect      = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_tracing.insecure = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] profiler.connection_string     = messaging:// {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] profiler.enabled               = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] profiler.es_doc_type           = notification {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] profiler.es_scroll_size        = 10000 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] profiler.es_scroll_time        = 2m {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] profiler.filter_error_trace    = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] profiler.hmac_keys             = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] profiler.sentinel_service_name = mymaster {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] profiler.socket_timeout        = 0.1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] profiler.trace_requests        = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] profiler.trace_sqlalchemy      = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] profiler_jaeger.process_tags   = {} {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] profiler_jaeger.service_name_prefix = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] profiler_otlp.service_name_prefix = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_policy.enforce_new_defaults = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_policy.policy_default_rule = default {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] privsep_osbrick.group          = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] privsep_osbrick.helper_command = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] privsep_osbrick.user           = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cinder_sys_admin.group         = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cinder_sys_admin.helper_command = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] cinder_sys_admin.user          = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] service_user.auth_section      = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] service_user.auth_type         = password {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] service_user.cafile            = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] service_user.certfile          = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] service_user.collect_timing    = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] service_user.insecure          = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] service_user.keyfile           = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] service_user.send_service_user_token = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] service_user.split_loggers     = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] service_user.timeout           = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] service_user.tls_ciphers       = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] service_user.tls_min_version   = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] glance.auth_section            = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] glance.auth_type               = password {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] glance.certfile                = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] glance.collect_timing          = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] glance.insecure                = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] glance.keyfile                 = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] glance.region_name             = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] glance.split_loggers           = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] glance.timeout                 = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] glance.tls_ciphers             = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] glance.tls_min_version         = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.backend_availability_zone = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.chap_password = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.chap_username =  {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86165) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 16 16:06:38 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.quobyte [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.disk_geometry = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.driver_client_cert = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.driver_client_cert_key = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.driver_data_namespace = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.driver_use_ssl = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.extra_capabilities = {} {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.quobyte [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.filter_function = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.goodness_function = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Running cmd (subprocess): mount.quobyte {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.iscsi_target_flags =  {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.iscsi_write_cache = on {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.iser_helper   = tgtadm {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.iser_ip_address = 192.168.122.127 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.iser_port     = 3260 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.nas_host      =  {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.nas_login     = admin {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.nas_mount_options = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.nas_password  = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.nas_private_key =  {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.nas_share_path =  {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.num_shell_tries = 3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.quobyte_volume_url = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.replication_device = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.report_discard_supported = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.reserved_percentage = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.target_helper = tgtadm {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.target_ip_address = 192.168.122.127 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.target_port   = 3260 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.target_protocol = iscsi {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.trace_flags   = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.unique_fqdn_network = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.use_chap_auth = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.volume_backend_name = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.volume_clear  = zero {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.volume_clear_ionice = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.volume_clear_size = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_reports.file_event_handler = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_reports.log_dir           = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.backend_availability_zone = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.backend_host         = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.chap_password        = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.chap_username        = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.chiscsi_conf         = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.disk_geometry        = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.driver_client_cert   = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.driver_data_namespace = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.driver_use_ssl       = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.extra_capabilities   = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.filter_function      = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.goodness_function    = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.iser_helper          = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.iser_ip_address      = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.iser_port            = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.iser_target_prefix   = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.nas_host             = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.nas_login            = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.nas_mount_options    = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.nas_password         = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.nas_private_key      = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.nas_share_path       = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.nas_ssh_port         = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.num_shell_tries      = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.nvmet_port_id        = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.replication_device   = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.report_discard_supported = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.reserved_percentage  = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.scst_target_driver   = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.storage_protocol     = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.target_helper        = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.target_ip_address    = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.target_port          = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.target_prefix        = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.target_protocol      = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.trace_flags          = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.use_chap_auth        = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.volume_clear         = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.volume_clear_size    = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] QuobyteHD.volumes_dir          = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_notifications.driver = [] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_notifications.retry = -1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] key_manager.fixed_key          = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican.barbican_api_version  = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican.barbican_endpoint     = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican.barbican_endpoint_type = public {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican.barbican_region_name  = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican.cafile                = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican.certfile              = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican.collect_timing        = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican.insecure              = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican.keyfile               = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican.number_of_retries     = 60 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican.retry_delay           = 1 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican.send_service_user_token = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican.split_loggers         = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican.timeout               = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican.tls_ciphers           = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican.tls_min_version       = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican.verify_ssl            = True {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican.verify_ssl_path       = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican_service_user.auth_section = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican_service_user.auth_type = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican_service_user.cafile   = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican_service_user.certfile = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican_service_user.collect_timing = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican_service_user.insecure = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican_service_user.keyfile  = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican_service_user.split_loggers = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican_service_user.timeout  = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican_service_user.tls_ciphers = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] barbican_service_user.tls_min_version = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] vault.approle_role_id          = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] vault.approle_secret_id        = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] vault.auth_method              = approle {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] vault.auth_path                = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] vault.kv_mountpoint            = secret {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] vault.kv_path                  = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] vault.kv_version               = 2 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] vault.namespace                = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] vault.root_token_id            = **** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] vault.ssl_ca_crt_file          = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] vault.timeout                  = 60.0 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] vault.token_file               = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] vault.token_role               = None {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] vault.use_ssl                  = False {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 16 16:06:38 devstack cinder-volume[85887]: DEBUG oslo_service.backend._eventlet.service [None req-4594ad8b-b5c0-437a-8f92-8bbcb05971d1 None None] ******************************************************************************** {{(pid=85887) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 16 16:06:38 devstack quobyte-client[86179]: Reading configuration file: /etc/quobyte/client.cfg
Sep 16 16:06:38 devstack quobyte-client[86179]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] CMD "mount.quobyte" returned: 1 in 0.116s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:06:39 devstack sudo[86180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:06:39 devstack sudo[86180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:06:39 devstack sudo[86180]: pam_unix(sudo:session): session closed for user root
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.285s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:06:39 devstack cinder-volume[86165]: INFO cinder.volume.driver [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Driver hasn't implemented _init_vendor_properties()
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG cinder.volume.driver [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.9149932861328, 'free_capacity_gb': 1775.9149932861328, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86165) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG oslo_db.sqlalchemy.engines [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86165) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writer thread running {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG cinder.db.api [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Building query based on filter {{(pid=86165) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86165) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:06:39 devstack cinder-volume[86165]: INFO cinder.keymgr.migration [None req-2d0e63ff-53b2-4e8a-8889-f27ed3b7f2e9 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 16 16:06:39 devstack sudo[86196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:06:39 devstack sudo[86196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:06:39 devstack sudo[86196]: pam_unix(sudo:session): session closed for user root
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.232s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:06:39 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Driver initialization completed successfully.
Sep 16 16:06:39 devstack cinder-volume[86165]: INFO cinder.manager [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Initiating service 3 cleanup
Sep 16 16:06:39 devstack cinder-volume[86165]: INFO cinder.manager [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Service 3 cleanup completed.
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG cinder.service [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Creating RPC server for service cinder-volume {{(pid=86165) start /opt/stack/cinder/cinder/service.py:231}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG cinder.service [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86165) start /opt/stack/cinder/cinder/service.py:237}}
Sep 16 16:06:39 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:06:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:06:39 devstack sudo[86208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:06:39 devstack sudo[86208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:06:40 devstack sudo[86208]: pam_unix(sudo:session): session closed for user root
Sep 16 16:06:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.256s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:06:40 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c565ded6-233d-4f9f-a274-bcec4149d165 None None] Driver post RPC initialization completed successfully.
Sep 16 16:06:48 devstack cinder-volume[85887]: DEBUG dbcounter [-] [85887] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:06:49 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:06:50 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=4 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:07:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:07:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 6 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:07:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:07:37 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:07:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Flow 'volume_create_manager' (4b8f98ed-34f7-4045-9704-6a521eaac274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:07:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02bbf538-f622-478c-a70d-de182c091f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:07:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02bbf538-f622-478c-a70d-de182c091f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1483624475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a491f82-cc91-45d5-91dd-95aa096cc030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98055fa201a740389416c8c08231ae3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:07:38Z,use_quota=True,user_id='ac3554a8ffee404aa4ac97ded4f08aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:07:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3147e707-4a6b-40c9-be76-ae632db42429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:07:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3147e707-4a6b-40c9-be76-ae632db42429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:07:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c92d1fe-8248-47ed-8956-7159b0cc9c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:07:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c92d1fe-8248-47ed-8956-7159b0cc9c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a491f82-cc91-45d5-91dd-95aa096cc030', 'volume_name': 'volume-0a491f82-cc91-45d5-91dd-95aa096cc030', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:07:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (752deb51-4059-4c37-b189-0c66556c175e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:07:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (752deb51-4059-4c37-b189-0c66556c175e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:07:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9df6ab4-215d-438c-80da-a142571d23c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:07:37 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Volume 0a491f82-cc91-45d5-91dd-95aa096cc030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a491f82-cc91-45d5-91dd-95aa096cc030', 'volume_size': 1}
Sep 16 16:07:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:07:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:07:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1483624475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a491f82-cc91-45d5-91dd-95aa096cc030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98055fa201a740389416c8c08231ae3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:07:38Z,use_quota=True,user_id='ac3554a8ffee404aa4ac97ded4f08aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:07:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Creating volume 0a491f82-cc91-45d5-91dd-95aa096cc030 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:07:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:07:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:07:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:07:38 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:07:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:07:38 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:07:38 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:07:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0a491f82-cc91-45d5-91dd-95aa096cc030 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:07:38 devstack sudo[86555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0a491f82-cc91-45d5-91dd-95aa096cc030 1073741824
Sep 16 16:07:38 devstack sudo[86555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:07:38 devstack sudo[86555]: pam_unix(sudo:session): session closed for user root
Sep 16 16:07:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0a491f82-cc91-45d5-91dd-95aa096cc030 1073741824" returned: 0 in 0.689s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:07:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0a491f82-cc91-45d5-91dd-95aa096cc030 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:07:38 devstack sudo[86875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0a491f82-cc91-45d5-91dd-95aa096cc030
Sep 16 16:07:38 devstack sudo[86875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:07:39 devstack sudo[86875]: pam_unix(sudo:session): session closed for user root
Sep 16 16:07:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0a491f82-cc91-45d5-91dd-95aa096cc030" returned: 0 in 0.303s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:07:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:07:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:07:39 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9df6ab4-215d-438c-80da-a142571d23c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a491f82-cc91-45d5-91dd-95aa096cc030', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:07:39 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ccf983-9de0-42b1-8c22-4c718bd2885b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:07:39 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Volume volume-0a491f82-cc91-45d5-91dd-95aa096cc030 (0a491f82-cc91-45d5-91dd-95aa096cc030): created successfully
Sep 16 16:07:39 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ccf983-9de0-42b1-8c22-4c718bd2885b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:07:39 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Flow 'volume_create_manager' (4b8f98ed-34f7-4045-9704-6a521eaac274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:07:39 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-82a91ac1-6a68-4c0e-98c7-797d5eae4330 tempest-TaggedAttachmentsTest-29506326 None] Created volume successfully.
Sep 16 16:07:49 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:07:49 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:07:56 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:07:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Flow 'volume_create_manager' (dbf79a54-d6b2-4e20-9a6f-ff76610b6a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:07:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c391b6-0fcb-418b-84ba-2c5599eeb126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:07:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c391b6-0fcb-418b-84ba-2c5599eeb126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-795047685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3173213-8fc5-49bf-9a38-3b2b0d8fc28c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7113fd0c18ac4beeac59a2820bec7031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:07:56Z,use_quota=True,user_id='22ddb11f20b34fdaac27a47753594e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:07:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d79c74-d781-4565-84a9-84103b2b2079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:07:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d79c74-d781-4565-84a9-84103b2b2079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:07:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11006d6-b49a-441a-a61e-1c34b1192e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:07:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11006d6-b49a-441a-a61e-1c34b1192e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3173213-8fc5-49bf-9a38-3b2b0d8fc28c', 'volume_name': 'volume-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:07:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf854e26-df92-4780-becf-3617d49e08aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:07:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf854e26-df92-4780-becf-3617d49e08aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:07:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32d32f4-27a9-4e28-a81e-f09ea5ce151b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:07:56 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Volume e3173213-8fc5-49bf-9a38-3b2b0d8fc28c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c', 'volume_size': 1}
Sep 16 16:07:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:07:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:07:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-795047685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3173213-8fc5-49bf-9a38-3b2b0d8fc28c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7113fd0c18ac4beeac59a2820bec7031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:07:56Z,use_quota=True,user_id='22ddb11f20b34fdaac27a47753594e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:07:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Creating volume e3173213-8fc5-49bf-9a38-3b2b0d8fc28c {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:07:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:07:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:07:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:07:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:07:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:07:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:07:56 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:07:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:07:56 devstack sudo[87112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c 1073741824
Sep 16 16:07:56 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:07:57 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root
Sep 16 16:07:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c 1073741824" returned: 0 in 0.957s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:07:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:07:57 devstack sudo[87147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c
Sep 16 16:07:57 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:07:57 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root
Sep 16 16:07:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c" returned: 0 in 0.406s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:07:57 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:07:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:07:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32d32f4-27a9-4e28-a81e-f09ea5ce151b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:07:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a97b5b0-146e-44a5-9aaa-f537b23b7b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:07:57 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Volume volume-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c (e3173213-8fc5-49bf-9a38-3b2b0d8fc28c): created successfully
Sep 16 16:07:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a97b5b0-146e-44a5-9aaa-f537b23b7b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:07:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Flow 'volume_create_manager' (dbf79a54-d6b2-4e20-9a6f-ff76610b6a6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:07:57 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-71f2ad0a-c003-4213-a2c7-e51ea3a47250 tempest-DeleteServersTestJSON-371842526 None] Created volume successfully.
Sep 16 16:08:06 devstack cinder-volume[86165]: WARNING py.warnings [req-21a61d7e-ef76-4595-bc35-0962edbd2f45 req-6b3989c7-f186-48e7-ac89-ba21c8c76a1d tempest-DeleteServersTestJSON-371842526 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Sep 16 16:08:06 devstack cinder-volume[86165]:   .first()
Sep 16 16:08:06 devstack cinder-volume[86165]: 
Sep 16 16:08:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-21a61d7e-ef76-4595-bc35-0962edbd2f45 req-6b3989c7-f186-48e7-ac89-ba21c8c76a1d tempest-DeleteServersTestJSON-371842526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:08:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-21a61d7e-ef76-4595-bc35-0962edbd2f45 req-6b3989c7-f186-48e7-ac89-ba21c8c76a1d tempest-DeleteServersTestJSON-371842526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:08:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-21a61d7e-ef76-4595-bc35-0962edbd2f45 req-6b3989c7-f186-48e7-ac89-ba21c8c76a1d tempest-DeleteServersTestJSON-371842526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:08:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-21a61d7e-ef76-4595-bc35-0962edbd2f45 req-6b3989c7-f186-48e7-ac89-ba21c8c76a1d tempest-DeleteServersTestJSON-371842526 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a073b220-8421-4921-9ca3-7f4012a487e6', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:08:07 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-21a61d7e-ef76-4595-bc35-0962edbd2f45 req-6b3989c7-f186-48e7-ac89-ba21c8c76a1d tempest-DeleteServersTestJSON-371842526 None] attachment_update completed successfully.
Sep 16 16:08:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:08:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:08:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:08:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:08:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:08:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:08:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:07 devstack sudo[87356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:08:07 devstack sudo[87356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:08 devstack sudo[87356]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 1.037s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 6 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Flow 'volume_create_manager' (cd9225b0-bb06-4297-8c49-738665465c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c4f672-90df-4881-ad78-642d627014cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c4f672-90df-4881-ad78-642d627014cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-744390510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfd9764-2430-40a3-a2b8-97da053a4bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d197b6c4359e4b46a652dfac14e7a3a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:08:08Z,use_quota=True,user_id='dc75b06642f844afbc1557bc5638afa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf1ae7d-c8e8-4964-9035-c48eca6c65ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf1ae7d-c8e8-4964-9035-c48eca6c65ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42adca0-c88d-47fe-9f5a-1e9d002ec6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42adca0-c88d-47fe-9f5a-1e9d002ec6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbfd9764-2430-40a3-a2b8-97da053a4bd5', 'volume_name': 'volume-bbfd9764-2430-40a3-a2b8-97da053a4bd5', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (849c90ea-012e-473d-b2af-56a6cd9fb8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (849c90ea-012e-473d-b2af-56a6cd9fb8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08f05f8-8fce-42c9-a50f-46f7935adfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:08:08 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Volume bbfd9764-2430-40a3-a2b8-97da053a4bd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbfd9764-2430-40a3-a2b8-97da053a4bd5', 'volume_size': 1}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-744390510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfd9764-2430-40a3-a2b8-97da053a4bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d197b6c4359e4b46a652dfac14e7a3a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:08:08Z,use_quota=True,user_id='dc75b06642f844afbc1557bc5638afa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Creating volume bbfd9764-2430-40a3-a2b8-97da053a4bd5 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:08:08 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:08:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bbfd9764-2430-40a3-a2b8-97da053a4bd5 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:08 devstack sudo[87783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bbfd9764-2430-40a3-a2b8-97da053a4bd5 1073741824
Sep 16 16:08:08 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:09 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bbfd9764-2430-40a3-a2b8-97da053a4bd5 1073741824" returned: 0 in 0.978s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bbfd9764-2430-40a3-a2b8-97da053a4bd5 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:09 devstack sudo[87791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bbfd9764-2430-40a3-a2b8-97da053a4bd5
Sep 16 16:08:09 devstack sudo[87791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bbfd9764-2430-40a3-a2b8-97da053a4bd5" returned: 0 in 0.664s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:08:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:08:10 devstack sudo[87791]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08f05f8-8fce-42c9-a50f-46f7935adfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbfd9764-2430-40a3-a2b8-97da053a4bd5', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:08:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50499cf1-e14f-40ba-bbe3-cf3aa9329046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:08:10 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Volume volume-bbfd9764-2430-40a3-a2b8-97da053a4bd5 (bbfd9764-2430-40a3-a2b8-97da053a4bd5): created successfully
Sep 16 16:08:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50499cf1-e14f-40ba-bbe3-cf3aa9329046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:08:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Flow 'volume_create_manager' (cd9225b0-bb06-4297-8c49-738665465c1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:08:10 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-7e1030ce-74a5-4d40-95ec-acb21d0533ae tempest-VolumesAdminNegativeTest-1063664260 None] Created volume successfully.
Sep 16 16:08:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] Acquiring lock "cinder-bbfd9764-2430-40a3-a2b8-97da053a4bd5-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:08:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] Lock "cinder-bbfd9764-2430-40a3-a2b8-97da053a4bd5-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:08:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] Acquiring lock "cinder-quobyte-bbfd9764-2430-40a3-a2b8-97da053a4bd5" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:08:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] Lock "cinder-quobyte-bbfd9764-2430-40a3-a2b8-97da053a4bd5" acquired by "delete_volume" :: waited 0.064s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:08:12 devstack cinder-volume[86165]: INFO oslo.privsep.daemon [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp86su087j/privsep.sock']
Sep 16 16:08:12 devstack sudo[87849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp86su087j/privsep.sock
Sep 16 16:08:12 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:14 devstack cinder-volume[86165]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 16 16:08:14 devstack cinder-volume[86165]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 16 16:08:14 devstack cinder-volume[86165]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 16 16:08:14 devstack cinder-volume[86165]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 16 16:08:14 devstack cinder-volume[86165]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 16 16:08:14 devstack cinder-volume[86165]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 16 16:08:14 devstack cinder-volume[86165]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 16 16:08:14 devstack cinder-volume[86165]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 16 16:08:14 devstack cinder-volume[86165]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 16 16:08:14 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:14 devstack cinder-volume[86165]: INFO oslo.privsep.daemon [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] Spawned new privsep daemon via rootwrap
Sep 16 16:08:14 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] Accepted privsep connection to /tmp/tmp86su087j/privsep.sock {{(pid=86165) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 16 16:08:14 devstack cinder-volume[86165]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 16 16:08:14 devstack cinder-volume[86165]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 16 16:08:14 devstack cinder-volume[86165]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 16 16:08:14 devstack cinder-volume[86165]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87857
Sep 16 16:08:14 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[def982e1-41dc-4653-969c-d48897978073]: (2,) {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:08:15 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a93227-0218-4dd5-90d6-e8c4e5ba20d2]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:08:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bbfd9764-2430-40a3-a2b8-97da053a4bd5 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:15 devstack sudo[87860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bbfd9764-2430-40a3-a2b8-97da053a4bd5
Sep 16 16:08:15 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:15 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bbfd9764-2430-40a3-a2b8-97da053a4bd5" returned: 0 in 0.911s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bbfd9764-2430-40a3-a2b8-97da053a4bd5 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:16 devstack sudo[87866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bbfd9764-2430-40a3-a2b8-97da053a4bd5
Sep 16 16:08:16 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:16 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-c404b43a-6614-4a43-b820-f79e22b3608c req-68986639-e90b-4414-8c85-5ee8124a8e0a tempest-DeleteServersTestJSON-371842526 None] Terminate volume connection completed successfully.
Sep 16 16:08:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-c404b43a-6614-4a43-b820-f79e22b3608c req-68986639-e90b-4414-8c85-5ee8124a8e0a tempest-DeleteServersTestJSON-371842526 None] Deleting attachment a073b220-8421-4921-9ca3-7f4012a487e6. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:08:16 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bbfd9764-2430-40a3-a2b8-97da053a4bd5" returned: 0 in 0.626s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] Lock "cinder-quobyte-bbfd9764-2430-40a3-a2b8-97da053a4bd5" released by "delete_volume" :: held 4.367s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:08:16 devstack cinder-volume[86165]: WARNING cinder.quota [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:08:16 devstack cinder-volume[86165]: WARNING cinder.quota [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:08:16 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] Created reservations ['1bc66cb5-d7f5-41ae-8fe7-98d17ccd481f', 'c2dce790-1ddc-4d62-b801-68a45fbae162', '42e66040-31b0-4a8c-9a0c-8475c809148e', 'a58425ca-449b-4aac-b3dd-a33085fef0fc'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:08:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:08:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:08:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:08:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:08:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:08:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:17 devstack sudo[87872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:08:17 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:17 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.468s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:17 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:08:17 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] Deleted volume successfully.
Sep 16 16:08:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fc081fac-7faa-46b9-9635-26f0db8d8ae2 tempest-VolumesAdminNegativeTest-1063664260 None] Lock "cinder-bbfd9764-2430-40a3-a2b8-97da053a4bd5-delete_volume" released by "delete_volume" :: held 5.490s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:08:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-064bd362-fc1d-44e9-9cb0-4543e3abb167 tempest-DeleteServersTestJSON-371842526 None] Acquiring lock "cinder-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:08:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-064bd362-fc1d-44e9-9cb0-4543e3abb167 tempest-DeleteServersTestJSON-371842526 None] Lock "cinder-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:08:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-064bd362-fc1d-44e9-9cb0-4543e3abb167 tempest-DeleteServersTestJSON-371842526 None] Acquiring lock "cinder-quobyte-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:08:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-064bd362-fc1d-44e9-9cb0-4543e3abb167 tempest-DeleteServersTestJSON-371842526 None] Lock "cinder-quobyte-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c" acquired by "delete_volume" :: waited 0.029s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:08:19 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84f495d-1e15-4789-8b3b-482956ee918d]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:08:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-064bd362-fc1d-44e9-9cb0-4543e3abb167 tempest-DeleteServersTestJSON-371842526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:19 devstack sudo[87899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c
Sep 16 16:08:19 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:20 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-064bd362-fc1d-44e9-9cb0-4543e3abb167 tempest-DeleteServersTestJSON-371842526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c" returned: 0 in 0.562s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-064bd362-fc1d-44e9-9cb0-4543e3abb167 tempest-DeleteServersTestJSON-371842526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:20 devstack sudo[87907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c
Sep 16 16:08:20 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:20 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-064bd362-fc1d-44e9-9cb0-4543e3abb167 tempest-DeleteServersTestJSON-371842526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c" returned: 0 in 0.409s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:20 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-064bd362-fc1d-44e9-9cb0-4543e3abb167 tempest-DeleteServersTestJSON-371842526 None] Lock "cinder-quobyte-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c" released by "delete_volume" :: held 1.045s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:08:20 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-064bd362-fc1d-44e9-9cb0-4543e3abb167 tempest-DeleteServersTestJSON-371842526 None] Created reservations ['5c51c22b-6636-4137-9beb-6a29f16bec3f', 'abe88a49-9117-47f2-b453-7f44e105143b', 'b9e540c9-4bc4-4c54-8a37-b3bca42c58f9', '77832c0e-cfcc-4275-936f-7da2a57b59b0'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:08:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-064bd362-fc1d-44e9-9cb0-4543e3abb167 tempest-DeleteServersTestJSON-371842526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:08:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-064bd362-fc1d-44e9-9cb0-4543e3abb167 tempest-DeleteServersTestJSON-371842526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:08:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-064bd362-fc1d-44e9-9cb0-4543e3abb167 tempest-DeleteServersTestJSON-371842526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:08:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-064bd362-fc1d-44e9-9cb0-4543e3abb167 tempest-DeleteServersTestJSON-371842526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:08:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-064bd362-fc1d-44e9-9cb0-4543e3abb167 tempest-DeleteServersTestJSON-371842526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:08:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-064bd362-fc1d-44e9-9cb0-4543e3abb167 tempest-DeleteServersTestJSON-371842526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:20 devstack sudo[87910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:08:20 devstack sudo[87910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:21 devstack sudo[87910]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-064bd362-fc1d-44e9-9cb0-4543e3abb167 tempest-DeleteServersTestJSON-371842526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.324s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:21 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-064bd362-fc1d-44e9-9cb0-4543e3abb167 tempest-DeleteServersTestJSON-371842526 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:08:21 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-064bd362-fc1d-44e9-9cb0-4543e3abb167 tempest-DeleteServersTestJSON-371842526 None] Deleted volume successfully.
Sep 16 16:08:21 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-064bd362-fc1d-44e9-9cb0-4543e3abb167 tempest-DeleteServersTestJSON-371842526 None] Lock "cinder-e3173213-8fc5-49bf-9a38-3b2b0d8fc28c-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:08:30 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=16,cinder:INSERT=7,cinder:UPDATE=26,cinder:DELETE=3 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:08:31 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=21,cinder:SELECT=27,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:08:32 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:08:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Flow 'volume_create_manager' (90422c91-0cda-45ac-8554-115fedd4e58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:08:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d4c8052-41c1-4495-a2e7-4176e82f4bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:08:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d4c8052-41c1-4495-a2e7-4176e82f4bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1186788433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e45fe0-d48e-4a1a-b12b-11b0084f9734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0834d7641f9473f91171eaafc13f8c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:08:32Z,use_quota=True,user_id='28ca30156d0a42d0b3dac6ac29dddbd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:08:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8c7621-99d6-4e05-9e45-9389da92cfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:08:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8c7621-99d6-4e05-9e45-9389da92cfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:08:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603d9d5f-a2be-4b34-ad87-96b84422660c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:08:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603d9d5f-a2be-4b34-ad87-96b84422660c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00e45fe0-d48e-4a1a-b12b-11b0084f9734', 'volume_name': 'volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:08:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46c8164-8984-460f-98ba-5e047ed3da3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:08:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46c8164-8984-460f-98ba-5e047ed3da3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:08:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ecc0c9-98bc-4a51-a4a4-a2ec6f427d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:08:32 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Volume 00e45fe0-d48e-4a1a-b12b-11b0084f9734: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734', 'volume_size': 1}
Sep 16 16:08:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:08:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:08:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1186788433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e45fe0-d48e-4a1a-b12b-11b0084f9734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0834d7641f9473f91171eaafc13f8c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:08:32Z,use_quota=True,user_id='28ca30156d0a42d0b3dac6ac29dddbd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:08:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Creating volume 00e45fe0-d48e-4a1a-b12b-11b0084f9734 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:08:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:08:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:08:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:08:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:08:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:08:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:08:32 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:08:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:32 devstack sudo[87943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734 1073741824
Sep 16 16:08:32 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:33 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734 1073741824" returned: 0 in 0.517s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:33 devstack sudo[87948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734
Sep 16 16:08:33 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:33 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734" returned: 0 in 0.295s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:08:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:08:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ecc0c9-98bc-4a51-a4a4-a2ec6f427d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:08:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7941a792-7d77-44c2-b18c-8eee3122edf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:08:33 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Volume volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734 (00e45fe0-d48e-4a1a-b12b-11b0084f9734): created successfully
Sep 16 16:08:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7941a792-7d77-44c2-b18c-8eee3122edf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:08:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Flow 'volume_create_manager' (90422c91-0cda-45ac-8554-115fedd4e58b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:08:33 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-3c150686-492f-4b3c-8ea0-c750bf09ada7 tempest-SnapshotsActionsTest-1212763247 None] Created volume successfully.
Sep 16 16:08:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-73f5d61d-eca2-44cc-945e-336cce81092a tempest-SnapshotsActionsTest-1212763247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:08:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-73f5d61d-eca2-44cc-945e-336cce81092a tempest-SnapshotsActionsTest-1212763247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:08:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-73f5d61d-eca2-44cc-945e-336cce81092a tempest-SnapshotsActionsTest-1212763247 None] Creating offline snapshot f08a3057-8b87-495b-a031-f0ca785a3c4e of volume 00e45fe0-d48e-4a1a-b12b-11b0084f9734 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:08:34 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc764d7-e2e0-4b9b-9fee-0e35d0060354]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:08:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-73f5d61d-eca2-44cc-945e-336cce81092a tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:35 devstack sudo[87964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734
Sep 16 16:08:35 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:35 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-73f5d61d-eca2-44cc-945e-336cce81092a tempest-SnapshotsActionsTest-1212763247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734" returned: 0 in 0.454s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-73f5d61d-eca2-44cc-945e-336cce81092a tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:35 devstack sudo[87969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e 1G
Sep 16 16:08:35 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:35 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-73f5d61d-eca2-44cc-945e-336cce81092a tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e 1G" returned: 0 in 0.521s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-73f5d61d-eca2-44cc-945e-336cce81092a tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:35 devstack sudo[87974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e
Sep 16 16:08:35 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:36 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-73f5d61d-eca2-44cc-945e-336cce81092a tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e" returned: 0 in 0.326s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:36 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-73f5d61d-eca2-44cc-945e-336cce81092a tempest-SnapshotsActionsTest-1212763247 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e is being set with open permissions: ugo+rw
Sep 16 16:08:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-73f5d61d-eca2-44cc-945e-336cce81092a tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:36 devstack sudo[87979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e
Sep 16 16:08:36 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:36 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-73f5d61d-eca2-44cc-945e-336cce81092a tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e" returned: 0 in 0.294s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-73f5d61d-eca2-44cc-945e-336cce81092a tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:36 devstack sudo[87982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.info
Sep 16 16:08:36 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:36 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-73f5d61d-eca2-44cc-945e-336cce81092a tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.info" returned: 0 in 0.356s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:36 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-73f5d61d-eca2-44cc-945e-336cce81092a tempest-SnapshotsActionsTest-1212763247 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.info is being set with open permissions: ugo+rw
Sep 16 16:08:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-73f5d61d-eca2-44cc-945e-336cce81092a tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:36 devstack sudo[87985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.info
Sep 16 16:08:36 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:37 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-73f5d61d-eca2-44cc-945e-336cce81092a tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.info" returned: 0 in 0.287s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-73f5d61d-eca2-44cc-945e-336cce81092a tempest-SnapshotsActionsTest-1212763247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.380s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:08:37 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-73f5d61d-eca2-44cc-945e-336cce81092a tempest-SnapshotsActionsTest-1212763247 None] Create snapshot completed successfully
Sep 16 16:08:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-70663ffa-7443-46a6-9d0f-b9db8062e63a tempest-SnapshotsActionsTest-1212763247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:08:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-70663ffa-7443-46a6-9d0f-b9db8062e63a tempest-SnapshotsActionsTest-1212763247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:08:38 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-70663ffa-7443-46a6-9d0f-b9db8062e63a tempest-SnapshotsActionsTest-1212763247 None] Creating offline snapshot f3669a07-1213-4062-8b85-cbf439db7029 of volume 00e45fe0-d48e-4a1a-b12b-11b0084f9734 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:08:38 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb44da8-47a9-4e6a-bfab-34ad26676991]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:08:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-70663ffa-7443-46a6-9d0f-b9db8062e63a tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:38 devstack sudo[87993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e
Sep 16 16:08:38 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:39 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-70663ffa-7443-46a6-9d0f-b9db8062e63a tempest-SnapshotsActionsTest-1212763247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e" returned: 0 in 0.470s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-70663ffa-7443-46a6-9d0f-b9db8062e63a tempest-SnapshotsActionsTest-1212763247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:08:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-70663ffa-7443-46a6-9d0f-b9db8062e63a tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f3669a07-1213-4062-8b85-cbf439db7029 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:39 devstack sudo[88000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f3669a07-1213-4062-8b85-cbf439db7029 1G
Sep 16 16:08:39 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:39 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-70663ffa-7443-46a6-9d0f-b9db8062e63a tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f3669a07-1213-4062-8b85-cbf439db7029 1G" returned: 0 in 0.658s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-70663ffa-7443-46a6-9d0f-b9db8062e63a tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f3669a07-1213-4062-8b85-cbf439db7029 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:40 devstack sudo[88008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f3669a07-1213-4062-8b85-cbf439db7029
Sep 16 16:08:40 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:40 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-70663ffa-7443-46a6-9d0f-b9db8062e63a tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f3669a07-1213-4062-8b85-cbf439db7029" returned: 0 in 0.366s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:40 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-70663ffa-7443-46a6-9d0f-b9db8062e63a tempest-SnapshotsActionsTest-1212763247 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f3669a07-1213-4062-8b85-cbf439db7029 is being set with open permissions: ugo+rw
Sep 16 16:08:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-70663ffa-7443-46a6-9d0f-b9db8062e63a tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f3669a07-1213-4062-8b85-cbf439db7029 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:40 devstack sudo[88014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f3669a07-1213-4062-8b85-cbf439db7029
Sep 16 16:08:40 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:40 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-70663ffa-7443-46a6-9d0f-b9db8062e63a tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f3669a07-1213-4062-8b85-cbf439db7029" returned: 0 in 0.284s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-70663ffa-7443-46a6-9d0f-b9db8062e63a tempest-SnapshotsActionsTest-1212763247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.931s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:08:40 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-70663ffa-7443-46a6-9d0f-b9db8062e63a tempest-SnapshotsActionsTest-1212763247 None] Create snapshot completed successfully
Sep 16 16:08:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] Acquiring lock "cinder-f3669a07-1213-4062-8b85-cbf439db7029-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:08:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-f3669a07-1213-4062-8b85-cbf439db7029-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:08:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] Acquiring lock "cinder-quobyte-00e45fe0-d48e-4a1a-b12b-11b0084f9734" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:08:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-quobyte-00e45fe0-d48e-4a1a-b12b-11b0084f9734" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:08:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] Acquiring lock "cinder-quobyte-f3669a07-1213-4062-8b85-cbf439db7029" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:08:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-quobyte-f3669a07-1213-4062-8b85-cbf439db7029" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:08:41 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] Deleting offline snapshot f3669a07-1213-4062-8b85-cbf439db7029 of volume 00e45fe0-d48e-4a1a-b12b-11b0084f9734 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:08:41 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] snapshot_file for this snap is: volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f3669a07-1213-4062-8b85-cbf439db7029 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:08:41 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf0cd53-2a16-440e-8b8a-a44642ae94f5]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:08:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f3669a07-1213-4062-8b85-cbf439db7029 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:41 devstack sudo[88017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f3669a07-1213-4062-8b85-cbf439db7029
Sep 16 16:08:41 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:41 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f3669a07-1213-4062-8b85-cbf439db7029" returned: 0 in 0.466s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:41 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:08:41 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffde5ce-b8e9-4721-8adb-d8d58e19ca21]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:08:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:41 devstack sudo[88023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e
Sep 16 16:08:41 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:42 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e" returned: 0 in 0.483s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:42 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:08:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f3669a07-1213-4062-8b85-cbf439db7029 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:42 devstack sudo[88028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f3669a07-1213-4062-8b85-cbf439db7029
Sep 16 16:08:42 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:42 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f3669a07-1213-4062-8b85-cbf439db7029" returned: 0 in 0.467s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f3669a07-1213-4062-8b85-cbf439db7029 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:42 devstack sudo[88034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f3669a07-1213-4062-8b85-cbf439db7029
Sep 16 16:08:42 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:43 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f3669a07-1213-4062-8b85-cbf439db7029" returned: 0 in 0.363s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-quobyte-f3669a07-1213-4062-8b85-cbf439db7029" released by "_delete_snapshot" :: held 1.934s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:08:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-quobyte-00e45fe0-d48e-4a1a-b12b-11b0084f9734" released by "delete_snapshot" :: held 1.970s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:08:43 devstack cinder-volume[86165]: WARNING cinder.quota [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:08:43 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] Created reservations ['d2482ede-837c-4219-b0c9-7f40e445f5e5', '426a0a3a-5adf-4117-a04c-2e2b5a748e9f', '282102ce-79e7-4f36-9bb2-a123a4b16e28', '99b76f5a-19e4-4a4d-9d54-c02b0d8a550b'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:08:43 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] Delete snapshot completed successfully.
Sep 16 16:08:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-39eb2ff7-22fe-47bf-831c-ec176807c1a9 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-f3669a07-1213-4062-8b85-cbf439db7029-delete_snapshot" released by "delete_snapshot" :: held 2.241s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:08:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-408015c2-599b-4556-81e9-d2723de1787e tempest-SnapshotsActionsTest-1212763247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:08:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-408015c2-599b-4556-81e9-d2723de1787e tempest-SnapshotsActionsTest-1212763247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:08:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-408015c2-599b-4556-81e9-d2723de1787e tempest-SnapshotsActionsTest-1212763247 None] Creating offline snapshot 267244f3-b9d8-4b42-8c1c-40db8aba168c of volume 00e45fe0-d48e-4a1a-b12b-11b0084f9734 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:08:44 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90711b3-b109-4219-821e-4e333fd76790]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:08:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-408015c2-599b-4556-81e9-d2723de1787e tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:45 devstack sudo[88045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e
Sep 16 16:08:45 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:45 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-408015c2-599b-4556-81e9-d2723de1787e tempest-SnapshotsActionsTest-1212763247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e" returned: 0 in 0.512s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-408015c2-599b-4556-81e9-d2723de1787e tempest-SnapshotsActionsTest-1212763247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:08:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-408015c2-599b-4556-81e9-d2723de1787e tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.267244f3-b9d8-4b42-8c1c-40db8aba168c 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:45 devstack sudo[88056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.267244f3-b9d8-4b42-8c1c-40db8aba168c 1G
Sep 16 16:08:45 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:46 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-408015c2-599b-4556-81e9-d2723de1787e tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.267244f3-b9d8-4b42-8c1c-40db8aba168c 1G" returned: 0 in 0.612s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-408015c2-599b-4556-81e9-d2723de1787e tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.267244f3-b9d8-4b42-8c1c-40db8aba168c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:46 devstack sudo[88074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.267244f3-b9d8-4b42-8c1c-40db8aba168c
Sep 16 16:08:46 devstack sudo[88074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:46 devstack sudo[88074]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-408015c2-599b-4556-81e9-d2723de1787e tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.267244f3-b9d8-4b42-8c1c-40db8aba168c" returned: 0 in 0.428s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:46 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-408015c2-599b-4556-81e9-d2723de1787e tempest-SnapshotsActionsTest-1212763247 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.267244f3-b9d8-4b42-8c1c-40db8aba168c is being set with open permissions: ugo+rw
Sep 16 16:08:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-408015c2-599b-4556-81e9-d2723de1787e tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.267244f3-b9d8-4b42-8c1c-40db8aba168c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:46 devstack sudo[88089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.267244f3-b9d8-4b42-8c1c-40db8aba168c
Sep 16 16:08:46 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:46 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-408015c2-599b-4556-81e9-d2723de1787e tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.267244f3-b9d8-4b42-8c1c-40db8aba168c" returned: 0 in 0.309s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-408015c2-599b-4556-81e9-d2723de1787e tempest-SnapshotsActionsTest-1212763247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.018s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:08:46 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-408015c2-599b-4556-81e9-d2723de1787e tempest-SnapshotsActionsTest-1212763247 None] Create snapshot completed successfully
Sep 16 16:08:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] Acquiring lock "cinder-267244f3-b9d8-4b42-8c1c-40db8aba168c-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:08:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-267244f3-b9d8-4b42-8c1c-40db8aba168c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:08:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] Acquiring lock "cinder-quobyte-00e45fe0-d48e-4a1a-b12b-11b0084f9734" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:08:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-quobyte-00e45fe0-d48e-4a1a-b12b-11b0084f9734" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:08:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] Acquiring lock "cinder-quobyte-267244f3-b9d8-4b42-8c1c-40db8aba168c" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:08:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-quobyte-267244f3-b9d8-4b42-8c1c-40db8aba168c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:08:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] Deleting offline snapshot 267244f3-b9d8-4b42-8c1c-40db8aba168c of volume 00e45fe0-d48e-4a1a-b12b-11b0084f9734 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:08:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] snapshot_file for this snap is: volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.267244f3-b9d8-4b42-8c1c-40db8aba168c {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:08:48 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d660674-43c3-4a37-9dde-830b6590aa46]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:08:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.267244f3-b9d8-4b42-8c1c-40db8aba168c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:48 devstack sudo[88107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.267244f3-b9d8-4b42-8c1c-40db8aba168c
Sep 16 16:08:48 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:49 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.267244f3-b9d8-4b42-8c1c-40db8aba168c" returned: 0 in 0.558s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:08:49 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1facf91a-e3b2-4b66-a532-94298cf5e2cd]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:08:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:49 devstack sudo[88120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e
Sep 16 16:08:49 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:49 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e" returned: 0 in 0.409s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:08:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.267244f3-b9d8-4b42-8c1c-40db8aba168c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:49 devstack sudo[88125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.267244f3-b9d8-4b42-8c1c-40db8aba168c
Sep 16 16:08:49 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:50 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.267244f3-b9d8-4b42-8c1c-40db8aba168c" returned: 0 in 0.504s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.267244f3-b9d8-4b42-8c1c-40db8aba168c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:50 devstack sudo[88132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.267244f3-b9d8-4b42-8c1c-40db8aba168c
Sep 16 16:08:50 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:50 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.267244f3-b9d8-4b42-8c1c-40db8aba168c" returned: 0 in 0.352s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-quobyte-267244f3-b9d8-4b42-8c1c-40db8aba168c" released by "_delete_snapshot" :: held 1.956s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:08:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-quobyte-00e45fe0-d48e-4a1a-b12b-11b0084f9734" released by "delete_snapshot" :: held 1.987s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:08:50 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] Created reservations ['e9b5756a-8230-4c25-bd9a-ca3a6ee76401', 'f165fee4-ecff-482a-b48e-88c11865d196', '81a0d069-be9e-4605-9870-9619159cb6fc', 'f5466d03-ed74-44c2-83cd-e607fa6599d9'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:08:50 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] Delete snapshot completed successfully.
Sep 16 16:08:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3bf0bc85-e960-4f3f-90d9-c5cb6a82af11 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-267244f3-b9d8-4b42-8c1c-40db8aba168c-delete_snapshot" released by "delete_snapshot" :: held 2.175s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:08:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6fa78b22-cd54-4d52-ab99-29207cc8e423 tempest-SnapshotsActionsTest-1212763247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:08:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6fa78b22-cd54-4d52-ab99-29207cc8e423 tempest-SnapshotsActionsTest-1212763247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:08:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-6fa78b22-cd54-4d52-ab99-29207cc8e423 tempest-SnapshotsActionsTest-1212763247 None] Creating offline snapshot 810fde17-eb66-4c69-9d6d-db97c6d82906 of volume 00e45fe0-d48e-4a1a-b12b-11b0084f9734 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:08:51 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cce2e00-8b8e-4708-8bef-8551e92f4f62]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:08:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6fa78b22-cd54-4d52-ab99-29207cc8e423 tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:51 devstack sudo[88136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e
Sep 16 16:08:51 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:52 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6fa78b22-cd54-4d52-ab99-29207cc8e423 tempest-SnapshotsActionsTest-1212763247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e" returned: 0 in 0.464s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-6fa78b22-cd54-4d52-ab99-29207cc8e423 tempest-SnapshotsActionsTest-1212763247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:08:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6fa78b22-cd54-4d52-ab99-29207cc8e423 tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.810fde17-eb66-4c69-9d6d-db97c6d82906 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:52 devstack sudo[88175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.810fde17-eb66-4c69-9d6d-db97c6d82906 1G
Sep 16 16:08:52 devstack sudo[88175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:52 devstack sudo[88175]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6fa78b22-cd54-4d52-ab99-29207cc8e423 tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.810fde17-eb66-4c69-9d6d-db97c6d82906 1G" returned: 0 in 0.697s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6fa78b22-cd54-4d52-ab99-29207cc8e423 tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.810fde17-eb66-4c69-9d6d-db97c6d82906 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:52 devstack sudo[88183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.810fde17-eb66-4c69-9d6d-db97c6d82906
Sep 16 16:08:52 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:53 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6fa78b22-cd54-4d52-ab99-29207cc8e423 tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.810fde17-eb66-4c69-9d6d-db97c6d82906" returned: 0 in 0.378s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:53 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-6fa78b22-cd54-4d52-ab99-29207cc8e423 tempest-SnapshotsActionsTest-1212763247 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.810fde17-eb66-4c69-9d6d-db97c6d82906 is being set with open permissions: ugo+rw
Sep 16 16:08:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6fa78b22-cd54-4d52-ab99-29207cc8e423 tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.810fde17-eb66-4c69-9d6d-db97c6d82906 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:53 devstack sudo[88188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.810fde17-eb66-4c69-9d6d-db97c6d82906
Sep 16 16:08:53 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:53 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6fa78b22-cd54-4d52-ab99-29207cc8e423 tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.810fde17-eb66-4c69-9d6d-db97c6d82906" returned: 0 in 0.291s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6fa78b22-cd54-4d52-ab99-29207cc8e423 tempest-SnapshotsActionsTest-1212763247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.988s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:08:53 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-6fa78b22-cd54-4d52-ab99-29207cc8e423 tempest-SnapshotsActionsTest-1212763247 None] Create snapshot completed successfully
Sep 16 16:08:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] Acquiring lock "cinder-810fde17-eb66-4c69-9d6d-db97c6d82906-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:08:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-810fde17-eb66-4c69-9d6d-db97c6d82906-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:08:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] Acquiring lock "cinder-quobyte-00e45fe0-d48e-4a1a-b12b-11b0084f9734" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:08:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-quobyte-00e45fe0-d48e-4a1a-b12b-11b0084f9734" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:08:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] Acquiring lock "cinder-quobyte-810fde17-eb66-4c69-9d6d-db97c6d82906" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:08:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-quobyte-810fde17-eb66-4c69-9d6d-db97c6d82906" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:08:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] Deleting offline snapshot 810fde17-eb66-4c69-9d6d-db97c6d82906 of volume 00e45fe0-d48e-4a1a-b12b-11b0084f9734 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:08:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] snapshot_file for this snap is: volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.810fde17-eb66-4c69-9d6d-db97c6d82906 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:08:53 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc01e335-79df-4e98-be5f-f1752cade811]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:08:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.810fde17-eb66-4c69-9d6d-db97c6d82906 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:54 devstack sudo[88192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.810fde17-eb66-4c69-9d6d-db97c6d82906
Sep 16 16:08:54 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:54 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.810fde17-eb66-4c69-9d6d-db97c6d82906" returned: 0 in 0.528s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:08:54 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7134cb7-b95b-4768-9f43-356d3f0b0640]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:08:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:54 devstack sudo[88197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e
Sep 16 16:08:54 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:55 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e" returned: 0 in 1.067s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:55 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:08:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.810fde17-eb66-4c69-9d6d-db97c6d82906 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:55 devstack sudo[88265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.810fde17-eb66-4c69-9d6d-db97c6d82906
Sep 16 16:08:55 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:56 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.810fde17-eb66-4c69-9d6d-db97c6d82906" returned: 0 in 0.708s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.810fde17-eb66-4c69-9d6d-db97c6d82906 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:56 devstack sudo[88285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.810fde17-eb66-4c69-9d6d-db97c6d82906
Sep 16 16:08:56 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:08:56 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root
Sep 16 16:08:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.810fde17-eb66-4c69-9d6d-db97c6d82906" returned: 0 in 0.522s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:08:56 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-quobyte-810fde17-eb66-4c69-9d6d-db97c6d82906" released by "_delete_snapshot" :: held 3.017s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:08:56 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-quobyte-00e45fe0-d48e-4a1a-b12b-11b0084f9734" released by "delete_snapshot" :: held 3.057s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:08:57 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] Created reservations ['100febc8-5903-41ab-9091-0251a74f3b9b', 'e86468e3-54d6-40c4-a556-f602e39df77b', '7d364779-4689-4882-9293-7dbca3f12b52', '93f56284-b96a-4bce-adee-974f68fa37bd'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:08:57 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] Delete snapshot completed successfully.
Sep 16 16:08:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b264cf6a-00e9-4530-aa39-5ccd90a66e76 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-810fde17-eb66-4c69-9d6d-db97c6d82906-delete_snapshot" released by "delete_snapshot" :: held 3.599s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:08:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cb09e749-3091-452d-b17a-ac2c717e2be4 tempest-SnapshotsActionsTest-1212763247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:08:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cb09e749-3091-452d-b17a-ac2c717e2be4 tempest-SnapshotsActionsTest-1212763247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:08:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-cb09e749-3091-452d-b17a-ac2c717e2be4 tempest-SnapshotsActionsTest-1212763247 None] Creating offline snapshot 1fd20fce-c412-40c5-a4e3-e56f1b94542d of volume 00e45fe0-d48e-4a1a-b12b-11b0084f9734 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:08:59 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a6a5dd-22aa-46a7-9bde-67377d5247e8]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:08:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cb09e749-3091-452d-b17a-ac2c717e2be4 tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:08:59 devstack sudo[88362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e
Sep 16 16:08:59 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:00 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cb09e749-3091-452d-b17a-ac2c717e2be4 tempest-SnapshotsActionsTest-1212763247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e" returned: 0 in 1.080s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-cb09e749-3091-452d-b17a-ac2c717e2be4 tempest-SnapshotsActionsTest-1212763247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:09:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cb09e749-3091-452d-b17a-ac2c717e2be4 tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.1fd20fce-c412-40c5-a4e3-e56f1b94542d 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:00 devstack sudo[88371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.1fd20fce-c412-40c5-a4e3-e56f1b94542d 1G
Sep 16 16:09:00 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-c170efb9-e37c-4c8c-9698-0f3b9b08c42e req-90bd4abc-d3f4-463d-bf21-b7fa37b345cf tempest-TaggedAttachmentsTest-29506326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:09:01 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cb09e749-3091-452d-b17a-ac2c717e2be4 tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.1fd20fce-c412-40c5-a4e3-e56f1b94542d 1G" returned: 0 in 0.941s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cb09e749-3091-452d-b17a-ac2c717e2be4 tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.1fd20fce-c412-40c5-a4e3-e56f1b94542d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:01 devstack sudo[88388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.1fd20fce-c412-40c5-a4e3-e56f1b94542d
Sep 16 16:09:01 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:01 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cb09e749-3091-452d-b17a-ac2c717e2be4 tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.1fd20fce-c412-40c5-a4e3-e56f1b94542d" returned: 0 in 0.404s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:01 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-cb09e749-3091-452d-b17a-ac2c717e2be4 tempest-SnapshotsActionsTest-1212763247 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.1fd20fce-c412-40c5-a4e3-e56f1b94542d is being set with open permissions: ugo+rw
Sep 16 16:09:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cb09e749-3091-452d-b17a-ac2c717e2be4 tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.1fd20fce-c412-40c5-a4e3-e56f1b94542d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:01 devstack sudo[88393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.1fd20fce-c412-40c5-a4e3-e56f1b94542d
Sep 16 16:09:01 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:02 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cb09e749-3091-452d-b17a-ac2c717e2be4 tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.1fd20fce-c412-40c5-a4e3-e56f1b94542d" returned: 0 in 0.304s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cb09e749-3091-452d-b17a-ac2c717e2be4 tempest-SnapshotsActionsTest-1212763247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.918s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:09:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-c170efb9-e37c-4c8c-9698-0f3b9b08c42e req-90bd4abc-d3f4-463d-bf21-b7fa37b345cf tempest-TaggedAttachmentsTest-29506326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.897s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:09:02 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-cb09e749-3091-452d-b17a-ac2c717e2be4 tempest-SnapshotsActionsTest-1212763247 None] Create snapshot completed successfully
Sep 16 16:09:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-c170efb9-e37c-4c8c-9698-0f3b9b08c42e req-90bd4abc-d3f4-463d-bf21-b7fa37b345cf tempest-TaggedAttachmentsTest-29506326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.092s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:09:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-c170efb9-e37c-4c8c-9698-0f3b9b08c42e req-90bd4abc-d3f4-463d-bf21-b7fa37b345cf tempest-TaggedAttachmentsTest-29506326 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-0a491f82-cc91-45d5-91dd-95aa096cc030', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd632916f-3ab0-4421-a4a7-3b73ca8bfcc1', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:09:02 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-c170efb9-e37c-4c8c-9698-0f3b9b08c42e req-90bd4abc-d3f4-463d-bf21-b7fa37b345cf tempest-TaggedAttachmentsTest-29506326 None] attachment_update completed successfully.
Sep 16 16:09:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] Acquiring lock "cinder-1fd20fce-c412-40c5-a4e3-e56f1b94542d-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:09:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-1fd20fce-c412-40c5-a4e3-e56f1b94542d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:09:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] Acquiring lock "cinder-quobyte-00e45fe0-d48e-4a1a-b12b-11b0084f9734" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:09:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-quobyte-00e45fe0-d48e-4a1a-b12b-11b0084f9734" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:09:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] Acquiring lock "cinder-quobyte-1fd20fce-c412-40c5-a4e3-e56f1b94542d" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:09:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-quobyte-1fd20fce-c412-40c5-a4e3-e56f1b94542d" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:09:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] Deleting offline snapshot 1fd20fce-c412-40c5-a4e3-e56f1b94542d of volume 00e45fe0-d48e-4a1a-b12b-11b0084f9734 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:09:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] snapshot_file for this snap is: volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.1fd20fce-c412-40c5-a4e3-e56f1b94542d {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:09:02 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[97361352-4f58-499d-ba93-1d9101b059fc]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:09:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.1fd20fce-c412-40c5-a4e3-e56f1b94542d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:03 devstack sudo[88813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.1fd20fce-c412-40c5-a4e3-e56f1b94542d
Sep 16 16:09:03 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:04 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.1fd20fce-c412-40c5-a4e3-e56f1b94542d" returned: 0 in 1.118s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:04 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:09:04 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c39d4e-16fd-4697-a7c4-6b5ad1c1698b]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:09:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:04 devstack sudo[88820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e
Sep 16 16:09:04 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:05 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e" returned: 0 in 0.917s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:09:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.1fd20fce-c412-40c5-a4e3-e56f1b94542d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:05 devstack sudo[88831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.1fd20fce-c412-40c5-a4e3-e56f1b94542d
Sep 16 16:09:05 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:06 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.1fd20fce-c412-40c5-a4e3-e56f1b94542d" returned: 0 in 1.028s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.1fd20fce-c412-40c5-a4e3-e56f1b94542d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:06 devstack sudo[88838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.1fd20fce-c412-40c5-a4e3-e56f1b94542d
Sep 16 16:09:06 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:06 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.1fd20fce-c412-40c5-a4e3-e56f1b94542d" returned: 0 in 0.534s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:06 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-quobyte-1fd20fce-c412-40c5-a4e3-e56f1b94542d" released by "_delete_snapshot" :: held 3.925s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:09:06 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-quobyte-00e45fe0-d48e-4a1a-b12b-11b0084f9734" released by "delete_snapshot" :: held 4.017s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:09:06 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] Created reservations ['f25dcbdd-2ba9-45dc-8238-4fae3edb0bfb', '92f1f9e7-b6bd-48bf-9659-2133cc690972', 'd6ed0207-9f45-4203-9f84-81204e1abfe6', '0143ca50-fe85-4316-862d-71fadd9c26ff'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:09:07 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] Delete snapshot completed successfully.
Sep 16 16:09:07 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-33e27f60-b92c-4d21-b6f6-719617335c89 tempest-SnapshotsActionsTest-1998241429 None] Lock "cinder-1fd20fce-c412-40c5-a4e3-e56f1b94542d-delete_snapshot" released by "delete_snapshot" :: held 4.404s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:09:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:09:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:09:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:09:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:09:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:09:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:09:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:07 devstack sudo[88841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:09:07 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:07 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.767s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:09:08 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-54e4909b-56a1-462d-9159-8dafc3ecb453 req-3b6736c1-60f4-4d48-806d-c431c78bc7fc tempest-TaggedAttachmentsTest-29506326 None] Terminate volume connection completed successfully.
Sep 16 16:09:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-54e4909b-56a1-462d-9159-8dafc3ecb453 req-3b6736c1-60f4-4d48-806d-c431c78bc7fc tempest-TaggedAttachmentsTest-29506326 None] Deleting attachment d632916f-3ab0-4421-a4a7-3b73ca8bfcc1. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:09:08 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cb07aeec-869f-4f87-828d-6a3533a129e4 tempest-SnapshotsActionsTest-1212763247 None] Acquiring lock "cinder-f08a3057-8b87-495b-a031-f0ca785a3c4e-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:09:08 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cb07aeec-869f-4f87-828d-6a3533a129e4 tempest-SnapshotsActionsTest-1212763247 None] Lock "cinder-f08a3057-8b87-495b-a031-f0ca785a3c4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:09:08 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cb07aeec-869f-4f87-828d-6a3533a129e4 tempest-SnapshotsActionsTest-1212763247 None] Acquiring lock "cinder-quobyte-00e45fe0-d48e-4a1a-b12b-11b0084f9734" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:09:08 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cb07aeec-869f-4f87-828d-6a3533a129e4 tempest-SnapshotsActionsTest-1212763247 None] Lock "cinder-quobyte-00e45fe0-d48e-4a1a-b12b-11b0084f9734" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:09:08 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cb07aeec-869f-4f87-828d-6a3533a129e4 tempest-SnapshotsActionsTest-1212763247 None] Acquiring lock "cinder-quobyte-f08a3057-8b87-495b-a031-f0ca785a3c4e" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:09:08 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cb07aeec-869f-4f87-828d-6a3533a129e4 tempest-SnapshotsActionsTest-1212763247 None] Lock "cinder-quobyte-f08a3057-8b87-495b-a031-f0ca785a3c4e" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:09:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-cb07aeec-869f-4f87-828d-6a3533a129e4 tempest-SnapshotsActionsTest-1212763247 None] Deleting offline snapshot f08a3057-8b87-495b-a031-f0ca785a3c4e of volume 00e45fe0-d48e-4a1a-b12b-11b0084f9734 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:09:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-cb07aeec-869f-4f87-828d-6a3533a129e4 tempest-SnapshotsActionsTest-1212763247 None] snapshot_file for this snap is: volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:09:08 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28b8132-6b2b-4ff8-84f1-9ebcd46ffe45]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:09:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cb07aeec-869f-4f87-828d-6a3533a129e4 tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:08 devstack sudo[88888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e
Sep 16 16:09:08 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:09 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cb07aeec-869f-4f87-828d-6a3533a129e4 tempest-SnapshotsActionsTest-1212763247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e" returned: 0 in 0.730s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-cb07aeec-869f-4f87-828d-6a3533a129e4 tempest-SnapshotsActionsTest-1212763247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:09:09 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0336039-0791-4dcc-aee3-678d47c394e3]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:09:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cb07aeec-869f-4f87-828d-6a3533a129e4 tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:09 devstack sudo[88918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734
Sep 16 16:09:09 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:10 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cb07aeec-869f-4f87-828d-6a3533a129e4 tempest-SnapshotsActionsTest-1212763247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734" returned: 0 in 0.996s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cb07aeec-869f-4f87-828d-6a3533a129e4 tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:10 devstack sudo[88940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e
Sep 16 16:09:10 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:11 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cb07aeec-869f-4f87-828d-6a3533a129e4 tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e" returned: 0 in 0.786s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cb07aeec-869f-4f87-828d-6a3533a129e4 tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:11 devstack sudo[88966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e
Sep 16 16:09:11 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:11 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cb07aeec-869f-4f87-828d-6a3533a129e4 tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734.f08a3057-8b87-495b-a031-f0ca785a3c4e" returned: 0 in 0.779s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cb07aeec-869f-4f87-828d-6a3533a129e4 tempest-SnapshotsActionsTest-1212763247 None] Lock "cinder-quobyte-f08a3057-8b87-495b-a031-f0ca785a3c4e" released by "_delete_snapshot" :: held 3.674s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:09:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cb07aeec-869f-4f87-828d-6a3533a129e4 tempest-SnapshotsActionsTest-1212763247 None] Lock "cinder-quobyte-00e45fe0-d48e-4a1a-b12b-11b0084f9734" released by "delete_snapshot" :: held 3.725s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:09:12 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-cb07aeec-869f-4f87-828d-6a3533a129e4 tempest-SnapshotsActionsTest-1212763247 None] Created reservations ['5268ec1a-912b-4dce-baa6-726e306b222b', '87fcd815-3d7e-4bac-9390-4fe600d7d6ab', 'e7655705-8169-410c-abf8-17c61e43637a', '047e55f0-2f7b-42a3-99aa-0423908c5cca'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:09:12 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-cb07aeec-869f-4f87-828d-6a3533a129e4 tempest-SnapshotsActionsTest-1212763247 None] Delete snapshot completed successfully.
Sep 16 16:09:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cb07aeec-869f-4f87-828d-6a3533a129e4 tempest-SnapshotsActionsTest-1212763247 None] Lock "cinder-f08a3057-8b87-495b-a031-f0ca785a3c4e-delete_snapshot" released by "delete_snapshot" :: held 4.126s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:09:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2bed107d-a74a-47d5-a760-08de9460dd5c tempest-SnapshotsActionsTest-1212763247 None] Acquiring lock "cinder-00e45fe0-d48e-4a1a-b12b-11b0084f9734-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:09:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2bed107d-a74a-47d5-a760-08de9460dd5c tempest-SnapshotsActionsTest-1212763247 None] Lock "cinder-00e45fe0-d48e-4a1a-b12b-11b0084f9734-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:09:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2bed107d-a74a-47d5-a760-08de9460dd5c tempest-SnapshotsActionsTest-1212763247 None] Acquiring lock "cinder-quobyte-00e45fe0-d48e-4a1a-b12b-11b0084f9734" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:09:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2bed107d-a74a-47d5-a760-08de9460dd5c tempest-SnapshotsActionsTest-1212763247 None] Lock "cinder-quobyte-00e45fe0-d48e-4a1a-b12b-11b0084f9734" acquired by "delete_volume" :: waited 0.036s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:09:13 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e640db2a-a1a3-468c-8a9f-450eb2081434]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:09:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2bed107d-a74a-47d5-a760-08de9460dd5c tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:13 devstack sudo[88996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734
Sep 16 16:09:13 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:13 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2bed107d-a74a-47d5-a760-08de9460dd5c tempest-SnapshotsActionsTest-1212763247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734" returned: 0 in 0.595s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2bed107d-a74a-47d5-a760-08de9460dd5c tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:13 devstack sudo[89001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734
Sep 16 16:09:13 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:13 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Flow 'volume_create_manager' (0987c7d0-0600-48ae-8e33-0f558136b6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef491aca-532f-488e-a6f2-aa2eba25e394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef491aca-532f-488e-a6f2-aa2eba25e394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-701309095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9955e6-0b9c-4fa2-85c1-4f815255a8f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ddb1604a2264ef7895f6f532510dcc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:09:14Z,use_quota=True,user_id='cf8aff1622854f8ea276729c5a62b44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de6999c-3a3f-4889-b84a-cea82e9375aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0de6999c-3a3f-4889-b84a-cea82e9375aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7098d58a-2aca-40bf-91ba-f350e0ae1c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7098d58a-2aca-40bf-91ba-f350e0ae1c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e9955e6-0b9c-4fa2-85c1-4f815255a8f8', 'volume_name': 'volume-8e9955e6-0b9c-4fa2-85c1-4f815255a8f8', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87f5728-671c-42cf-a3f9-4096d80cbc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87f5728-671c-42cf-a3f9-4096d80cbc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d01607-15e6-43f1-868b-83f20e13a20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:09:14 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Volume 8e9955e6-0b9c-4fa2-85c1-4f815255a8f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e9955e6-0b9c-4fa2-85c1-4f815255a8f8', 'volume_size': 1}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-701309095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9955e6-0b9c-4fa2-85c1-4f815255a8f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ddb1604a2264ef7895f6f532510dcc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:09:14Z,use_quota=True,user_id='cf8aff1622854f8ea276729c5a62b44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Creating volume 8e9955e6-0b9c-4fa2-85c1-4f815255a8f8 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:09:14 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8e9955e6-0b9c-4fa2-85c1-4f815255a8f8 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:14 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2bed107d-a74a-47d5-a760-08de9460dd5c tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-00e45fe0-d48e-4a1a-b12b-11b0084f9734" returned: 0 in 0.473s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:14 devstack sudo[89004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8e9955e6-0b9c-4fa2-85c1-4f815255a8f8 1073741824
Sep 16 16:09:14 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2bed107d-a74a-47d5-a760-08de9460dd5c tempest-SnapshotsActionsTest-1212763247 None] Lock "cinder-quobyte-00e45fe0-d48e-4a1a-b12b-11b0084f9734" released by "delete_volume" :: held 1.196s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-2bed107d-a74a-47d5-a760-08de9460dd5c tempest-SnapshotsActionsTest-1212763247 None] Created reservations ['4c5bf072-5a83-4604-b62d-e5837dc4f640', 'b628ad24-4e20-41d7-b0b3-db38c2af4ace', '9c9998eb-a5ad-48f2-a76e-b5f6cba4d0bd', 'ad612873-e3eb-4857-93e6-3c9c3fbd6c3b'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2bed107d-a74a-47d5-a760-08de9460dd5c tempest-SnapshotsActionsTest-1212763247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2bed107d-a74a-47d5-a760-08de9460dd5c tempest-SnapshotsActionsTest-1212763247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2bed107d-a74a-47d5-a760-08de9460dd5c tempest-SnapshotsActionsTest-1212763247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2bed107d-a74a-47d5-a760-08de9460dd5c tempest-SnapshotsActionsTest-1212763247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2bed107d-a74a-47d5-a760-08de9460dd5c tempest-SnapshotsActionsTest-1212763247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2bed107d-a74a-47d5-a760-08de9460dd5c tempest-SnapshotsActionsTest-1212763247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:14 devstack sudo[89008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:09:14 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:14 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:14 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2bed107d-a74a-47d5-a760-08de9460dd5c tempest-SnapshotsActionsTest-1212763247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.394s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-2bed107d-a74a-47d5-a760-08de9460dd5c tempest-SnapshotsActionsTest-1212763247 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8e9955e6-0b9c-4fa2-85c1-4f815255a8f8 1073741824" returned: 0 in 0.650s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:14 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-2bed107d-a74a-47d5-a760-08de9460dd5c tempest-SnapshotsActionsTest-1212763247 None] Deleted volume successfully.
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2bed107d-a74a-47d5-a760-08de9460dd5c tempest-SnapshotsActionsTest-1212763247 None] Lock "cinder-00e45fe0-d48e-4a1a-b12b-11b0084f9734-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:09:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8e9955e6-0b9c-4fa2-85c1-4f815255a8f8 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:14 devstack sudo[89013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8e9955e6-0b9c-4fa2-85c1-4f815255a8f8
Sep 16 16:09:14 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:15 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8e9955e6-0b9c-4fa2-85c1-4f815255a8f8" returned: 0 in 0.468s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:09:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:09:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d01607-15e6-43f1-868b-83f20e13a20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e9955e6-0b9c-4fa2-85c1-4f815255a8f8', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:09:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0e5524-5660-4110-98b6-3b4f54ce011e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:09:15 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Volume volume-8e9955e6-0b9c-4fa2-85c1-4f815255a8f8 (8e9955e6-0b9c-4fa2-85c1-4f815255a8f8): created successfully
Sep 16 16:09:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0e5524-5660-4110-98b6-3b4f54ce011e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:09:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Flow 'volume_create_manager' (0987c7d0-0600-48ae-8e33-0f558136b6de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:09:15 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-af598e9c-416e-4254-9ed0-97eb3df87cb1 tempest-ServerRescueNegativeTestJSON-386848559 None] Created volume successfully.
Sep 16 16:09:25 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=51,cinder:UPDATE=49,cinder:INSERT=13,cinder:DELETE=3 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:09:25 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=57,cinder:UPDATE=49,cinder:INSERT=14,cinder:DELETE=5 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:09:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ffdc523f-4c16-484f-b527-53c0177dc2c8 tempest-TaggedAttachmentsTest-29506326 None] Acquiring lock "cinder-0a491f82-cc91-45d5-91dd-95aa096cc030-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:09:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ffdc523f-4c16-484f-b527-53c0177dc2c8 tempest-TaggedAttachmentsTest-29506326 None] Lock "cinder-0a491f82-cc91-45d5-91dd-95aa096cc030-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:09:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ffdc523f-4c16-484f-b527-53c0177dc2c8 tempest-TaggedAttachmentsTest-29506326 None] Acquiring lock "cinder-quobyte-0a491f82-cc91-45d5-91dd-95aa096cc030" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:09:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ffdc523f-4c16-484f-b527-53c0177dc2c8 tempest-TaggedAttachmentsTest-29506326 None] Lock "cinder-quobyte-0a491f82-cc91-45d5-91dd-95aa096cc030" acquired by "delete_volume" :: waited 0.040s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:09:28 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6523b7f9-d9db-436a-a8db-77d00f9fef23]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:09:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ffdc523f-4c16-484f-b527-53c0177dc2c8 tempest-TaggedAttachmentsTest-29506326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0a491f82-cc91-45d5-91dd-95aa096cc030 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:28 devstack sudo[89172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0a491f82-cc91-45d5-91dd-95aa096cc030
Sep 16 16:09:28 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:29 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ffdc523f-4c16-484f-b527-53c0177dc2c8 tempest-TaggedAttachmentsTest-29506326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0a491f82-cc91-45d5-91dd-95aa096cc030" returned: 0 in 0.762s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ffdc523f-4c16-484f-b527-53c0177dc2c8 tempest-TaggedAttachmentsTest-29506326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0a491f82-cc91-45d5-91dd-95aa096cc030 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:29 devstack sudo[89177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0a491f82-cc91-45d5-91dd-95aa096cc030
Sep 16 16:09:29 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:29 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ffdc523f-4c16-484f-b527-53c0177dc2c8 tempest-TaggedAttachmentsTest-29506326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0a491f82-cc91-45d5-91dd-95aa096cc030" returned: 0 in 0.302s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ffdc523f-4c16-484f-b527-53c0177dc2c8 tempest-TaggedAttachmentsTest-29506326 None] Lock "cinder-quobyte-0a491f82-cc91-45d5-91dd-95aa096cc030" released by "delete_volume" :: held 1.139s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:09:29 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-ffdc523f-4c16-484f-b527-53c0177dc2c8 tempest-TaggedAttachmentsTest-29506326 None] Created reservations ['a24aae80-428d-444c-bc2c-dc3f89b8811a', '43202152-a016-4a82-b023-e46cd95a4fb7', 'bfedc309-f06b-4593-ae1f-58330557b8b9', '832313d0-86cd-48b6-86c5-202b61ddec8b'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:09:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ffdc523f-4c16-484f-b527-53c0177dc2c8 tempest-TaggedAttachmentsTest-29506326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:09:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ffdc523f-4c16-484f-b527-53c0177dc2c8 tempest-TaggedAttachmentsTest-29506326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:09:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ffdc523f-4c16-484f-b527-53c0177dc2c8 tempest-TaggedAttachmentsTest-29506326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:09:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ffdc523f-4c16-484f-b527-53c0177dc2c8 tempest-TaggedAttachmentsTest-29506326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:09:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ffdc523f-4c16-484f-b527-53c0177dc2c8 tempest-TaggedAttachmentsTest-29506326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:09:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ffdc523f-4c16-484f-b527-53c0177dc2c8 tempest-TaggedAttachmentsTest-29506326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:29 devstack sudo[89199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:09:29 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:30 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ffdc523f-4c16-484f-b527-53c0177dc2c8 tempest-TaggedAttachmentsTest-29506326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.412s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:30 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-ffdc523f-4c16-484f-b527-53c0177dc2c8 tempest-TaggedAttachmentsTest-29506326 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:09:30 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-ffdc523f-4c16-484f-b527-53c0177dc2c8 tempest-TaggedAttachmentsTest-29506326 None] Deleted volume successfully.
Sep 16 16:09:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ffdc523f-4c16-484f-b527-53c0177dc2c8 tempest-TaggedAttachmentsTest-29506326 None] Lock "cinder-0a491f82-cc91-45d5-91dd-95aa096cc030-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:09:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9bb5ffab-b019-47ea-b84e-021afbcda4ec tempest-ServerRescueNegativeTestJSON-386848559 None] Acquiring lock "cinder-8e9955e6-0b9c-4fa2-85c1-4f815255a8f8-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:09:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9bb5ffab-b019-47ea-b84e-021afbcda4ec tempest-ServerRescueNegativeTestJSON-386848559 None] Lock "cinder-8e9955e6-0b9c-4fa2-85c1-4f815255a8f8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:09:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9bb5ffab-b019-47ea-b84e-021afbcda4ec tempest-ServerRescueNegativeTestJSON-386848559 None] Acquiring lock "cinder-quobyte-8e9955e6-0b9c-4fa2-85c1-4f815255a8f8" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:09:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9bb5ffab-b019-47ea-b84e-021afbcda4ec tempest-ServerRescueNegativeTestJSON-386848559 None] Lock "cinder-quobyte-8e9955e6-0b9c-4fa2-85c1-4f815255a8f8" acquired by "delete_volume" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:09:32 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d60998b-9bca-469e-9070-84c9b995dec6]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:09:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9bb5ffab-b019-47ea-b84e-021afbcda4ec tempest-ServerRescueNegativeTestJSON-386848559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8e9955e6-0b9c-4fa2-85c1-4f815255a8f8 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:32 devstack sudo[89214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8e9955e6-0b9c-4fa2-85c1-4f815255a8f8
Sep 16 16:09:32 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:32 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9bb5ffab-b019-47ea-b84e-021afbcda4ec tempest-ServerRescueNegativeTestJSON-386848559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8e9955e6-0b9c-4fa2-85c1-4f815255a8f8" returned: 0 in 0.536s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9bb5ffab-b019-47ea-b84e-021afbcda4ec tempest-ServerRescueNegativeTestJSON-386848559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8e9955e6-0b9c-4fa2-85c1-4f815255a8f8 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:32 devstack sudo[89219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8e9955e6-0b9c-4fa2-85c1-4f815255a8f8
Sep 16 16:09:32 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:33 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9bb5ffab-b019-47ea-b84e-021afbcda4ec tempest-ServerRescueNegativeTestJSON-386848559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8e9955e6-0b9c-4fa2-85c1-4f815255a8f8" returned: 0 in 0.418s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9bb5ffab-b019-47ea-b84e-021afbcda4ec tempest-ServerRescueNegativeTestJSON-386848559 None] Lock "cinder-quobyte-8e9955e6-0b9c-4fa2-85c1-4f815255a8f8" released by "delete_volume" :: held 1.053s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:09:33 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-9bb5ffab-b019-47ea-b84e-021afbcda4ec tempest-ServerRescueNegativeTestJSON-386848559 None] Created reservations ['cfd764a0-8c04-4639-8c89-34b75c19857b', '077aa55d-0cbe-4f8e-9936-ab6c95808edb', '986a3ae4-ce46-47ba-9090-d9fb2f56dadf', '17f94b15-6194-4051-bc89-a3621857a85a'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:09:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9bb5ffab-b019-47ea-b84e-021afbcda4ec tempest-ServerRescueNegativeTestJSON-386848559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:09:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9bb5ffab-b019-47ea-b84e-021afbcda4ec tempest-ServerRescueNegativeTestJSON-386848559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:09:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9bb5ffab-b019-47ea-b84e-021afbcda4ec tempest-ServerRescueNegativeTestJSON-386848559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:09:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9bb5ffab-b019-47ea-b84e-021afbcda4ec tempest-ServerRescueNegativeTestJSON-386848559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:09:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9bb5ffab-b019-47ea-b84e-021afbcda4ec tempest-ServerRescueNegativeTestJSON-386848559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:09:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9bb5ffab-b019-47ea-b84e-021afbcda4ec tempest-ServerRescueNegativeTestJSON-386848559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:33 devstack sudo[89223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:09:33 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:33 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9bb5ffab-b019-47ea-b84e-021afbcda4ec tempest-ServerRescueNegativeTestJSON-386848559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.416s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:33 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-9bb5ffab-b019-47ea-b84e-021afbcda4ec tempest-ServerRescueNegativeTestJSON-386848559 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:09:33 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-9bb5ffab-b019-47ea-b84e-021afbcda4ec tempest-ServerRescueNegativeTestJSON-386848559 None] Deleted volume successfully.
Sep 16 16:09:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9bb5ffab-b019-47ea-b84e-021afbcda4ec tempest-ServerRescueNegativeTestJSON-386848559 None] Lock "cinder-8e9955e6-0b9c-4fa2-85c1-4f815255a8f8-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:09:43 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=10,cinder:UPDATE=19,cinder:INSERT=6 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:09:43 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=10,cinder:INSERT=2,cinder:UPDATE=13,cinder:DELETE=2 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:09:46 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:09:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Flow 'volume_create_manager' (facc74d9-f7b1-4d9d-844d-469f2ba37428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:09:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18789bb9-0ff4-4e77-a938-6cc8ad59b7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:09:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18789bb9-0ff4-4e77-a938-6cc8ad59b7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1814918998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8832599-21f4-486b-b397-15c2209a80fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9712a32960a418594c80e8915e82ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:09:47Z,use_quota=True,user_id='dc28bb02b88341f085e40dc7f63db670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:09:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8beeff13-e179-4d85-923d-ad3d61dde556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:09:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8beeff13-e179-4d85-923d-ad3d61dde556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:09:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4a6630-2c1f-42a4-8a5e-934763ee0b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:09:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4a6630-2c1f-42a4-8a5e-934763ee0b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8832599-21f4-486b-b397-15c2209a80fa', 'volume_name': 'volume-c8832599-21f4-486b-b397-15c2209a80fa', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:09:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e705102-e3e4-4d12-bd99-bd4e18f39c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:09:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e705102-e3e4-4d12-bd99-bd4e18f39c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:09:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac68dae-7c95-4a42-b2dd-67458a0762b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:09:47 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Volume c8832599-21f4-486b-b397-15c2209a80fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8832599-21f4-486b-b397-15c2209a80fa', 'volume_size': 1}
Sep 16 16:09:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:09:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:09:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1814918998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8832599-21f4-486b-b397-15c2209a80fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9712a32960a418594c80e8915e82ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:09:47Z,use_quota=True,user_id='dc28bb02b88341f085e40dc7f63db670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:09:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Creating volume c8832599-21f4-486b-b397-15c2209a80fa {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:09:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:09:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:09:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:09:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:09:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:09:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:09:47 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:09:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c8832599-21f4-486b-b397-15c2209a80fa 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:47 devstack sudo[89338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c8832599-21f4-486b-b397-15c2209a80fa 1073741824
Sep 16 16:09:47 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:47 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c8832599-21f4-486b-b397-15c2209a80fa 1073741824" returned: 0 in 0.643s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c8832599-21f4-486b-b397-15c2209a80fa {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:47 devstack sudo[89345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c8832599-21f4-486b-b397-15c2209a80fa
Sep 16 16:09:47 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:47 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c8832599-21f4-486b-b397-15c2209a80fa" returned: 0 in 0.256s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:09:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:09:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac68dae-7c95-4a42-b2dd-67458a0762b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8832599-21f4-486b-b397-15c2209a80fa', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:09:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1901c525-dac8-44e0-baf1-0c1a72bebaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:09:48 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Volume volume-c8832599-21f4-486b-b397-15c2209a80fa (c8832599-21f4-486b-b397-15c2209a80fa): created successfully
Sep 16 16:09:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1901c525-dac8-44e0-baf1-0c1a72bebaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:09:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Flow 'volume_create_manager' (facc74d9-f7b1-4d9d-844d-469f2ba37428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:09:48 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-ffda8f67-cad9-44c5-a6a8-586caf8d0132 tempest-AttachVolumeShelveTestJSON-1437213778 None] Created volume successfully.
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Flow 'volume_create_manager' (57c0e6a9-c793-41ca-9312-959f2357baa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d09fb44-2c99-46d2-8405-a631377860e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d09fb44-2c99-46d2-8405-a631377860e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2013002316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9861ae6-f91e-40fe-a4de-111216b6e4d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f871b364b85d403cbe3508e8a56a1a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:09:53Z,use_quota=True,user_id='46a3c8a303354effab795c91c7d027e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcf9076a-7bb6-4db8-8483-a48117901056),volume_type_id=bcf9076a-7bb6-4db8-8483-a48117901056)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00affa4-61d5-432c-bf0c-cecfda725704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00affa4-61d5-432c-bf0c-cecfda725704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb95d87a-a72f-4b78-b12c-5e692722c069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb95d87a-a72f-4b78-b12c-5e692722c069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9861ae6-f91e-40fe-a4de-111216b6e4d1', 'volume_name': 'volume-b9861ae6-f91e-40fe-a4de-111216b6e4d1', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77b277f-d101-4ea7-b162-cae3ef09d3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77b277f-d101-4ea7-b162-cae3ef09d3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36cf344f-cded-419d-92f9-6e8804799fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:09:53 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Volume b9861ae6-f91e-40fe-a4de-111216b6e4d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9861ae6-f91e-40fe-a4de-111216b6e4d1', 'volume_size': 1}
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2013002316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9861ae6-f91e-40fe-a4de-111216b6e4d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f871b364b85d403cbe3508e8a56a1a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:09:53Z,use_quota=True,user_id='46a3c8a303354effab795c91c7d027e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcf9076a-7bb6-4db8-8483-a48117901056),volume_type_id=bcf9076a-7bb6-4db8-8483-a48117901056)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Creating volume b9861ae6-f91e-40fe-a4de-111216b6e4d1 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:09:53 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b9861ae6-f91e-40fe-a4de-111216b6e4d1 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:53 devstack sudo[89404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b9861ae6-f91e-40fe-a4de-111216b6e4d1 1073741824
Sep 16 16:09:53 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:53 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b9861ae6-f91e-40fe-a4de-111216b6e4d1 1073741824" returned: 0 in 0.603s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b9861ae6-f91e-40fe-a4de-111216b6e4d1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:54 devstack sudo[89410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b9861ae6-f91e-40fe-a4de-111216b6e4d1
Sep 16 16:09:54 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:54 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b9861ae6-f91e-40fe-a4de-111216b6e4d1" returned: 0 in 0.282s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:09:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:09:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36cf344f-cded-419d-92f9-6e8804799fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9861ae6-f91e-40fe-a4de-111216b6e4d1', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:09:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03400fd6-3a3b-47b8-9d6e-1f8a9d0397ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:09:54 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Volume volume-b9861ae6-f91e-40fe-a4de-111216b6e4d1 (b9861ae6-f91e-40fe-a4de-111216b6e4d1): created successfully
Sep 16 16:09:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03400fd6-3a3b-47b8-9d6e-1f8a9d0397ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:09:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Flow 'volume_create_manager' (57c0e6a9-c793-41ca-9312-959f2357baa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:09:54 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-48a5537f-3fbe-4d2b-bacc-981943caf89b tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Created volume successfully.
Sep 16 16:09:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-dd8b258c-ff2e-44e5-898b-88480c5506c7 tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:09:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-dd8b258c-ff2e-44e5-898b-88480c5506c7 tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:09:55 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-dd8b258c-ff2e-44e5-898b-88480c5506c7 tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:09:55 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-dd8b258c-ff2e-44e5-898b-88480c5506c7 tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:09:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-dd8b258c-ff2e-44e5-898b-88480c5506c7 tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:09:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-dd8b258c-ff2e-44e5-898b-88480c5506c7 tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:55 devstack sudo[89413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:09:55 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:56 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-dd8b258c-ff2e-44e5-898b-88480c5506c7 tempest-VolumeRetypeWithoutMigrationTest-145164656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.310s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:56 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-dd8b258c-ff2e-44e5-898b-88480c5506c7 tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:09:56 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-dd8b258c-ff2e-44e5-898b-88480c5506c7 tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Retype volume completed successfully.
Sep 16 16:09:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fbf76682-5716-4809-b524-4068bd3bfe5c tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Acquiring lock "cinder-b9861ae6-f91e-40fe-a4de-111216b6e4d1-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:09:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fbf76682-5716-4809-b524-4068bd3bfe5c tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Lock "cinder-b9861ae6-f91e-40fe-a4de-111216b6e4d1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:09:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fbf76682-5716-4809-b524-4068bd3bfe5c tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Acquiring lock "cinder-quobyte-b9861ae6-f91e-40fe-a4de-111216b6e4d1" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:09:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fbf76682-5716-4809-b524-4068bd3bfe5c tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Lock "cinder-quobyte-b9861ae6-f91e-40fe-a4de-111216b6e4d1" acquired by "delete_volume" :: waited 0.015s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:09:57 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c635e6c-f46a-432e-9a3d-7617d5406fb6]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:09:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fbf76682-5716-4809-b524-4068bd3bfe5c tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b9861ae6-f91e-40fe-a4de-111216b6e4d1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:57 devstack sudo[89417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b9861ae6-f91e-40fe-a4de-111216b6e4d1
Sep 16 16:09:57 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:57 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fbf76682-5716-4809-b524-4068bd3bfe5c tempest-VolumeRetypeWithoutMigrationTest-145164656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b9861ae6-f91e-40fe-a4de-111216b6e4d1" returned: 0 in 0.461s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fbf76682-5716-4809-b524-4068bd3bfe5c tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b9861ae6-f91e-40fe-a4de-111216b6e4d1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:57 devstack sudo[89422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b9861ae6-f91e-40fe-a4de-111216b6e4d1
Sep 16 16:09:57 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:57 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fbf76682-5716-4809-b524-4068bd3bfe5c tempest-VolumeRetypeWithoutMigrationTest-145164656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b9861ae6-f91e-40fe-a4de-111216b6e4d1" returned: 0 in 0.302s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fbf76682-5716-4809-b524-4068bd3bfe5c tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Lock "cinder-quobyte-b9861ae6-f91e-40fe-a4de-111216b6e4d1" released by "delete_volume" :: held 0.808s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:09:58 devstack cinder-volume[86165]: WARNING cinder.quota [None req-fbf76682-5716-4809-b524-4068bd3bfe5c tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:09:58 devstack cinder-volume[86165]: WARNING cinder.quota [None req-fbf76682-5716-4809-b524-4068bd3bfe5c tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:09:58 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-fbf76682-5716-4809-b524-4068bd3bfe5c tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Created reservations ['ffd9a046-16cb-457f-87d6-d075d26850c0', '2f537d2c-8461-4296-8b82-784612074c1b', '8d1e2ba7-461e-4a39-a74e-4fc2b76f062e', 'e8640f17-3cf4-4ea7-9a20-a81e3594e6b2'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:09:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fbf76682-5716-4809-b524-4068bd3bfe5c tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:09:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fbf76682-5716-4809-b524-4068bd3bfe5c tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:09:58 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-fbf76682-5716-4809-b524-4068bd3bfe5c tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:09:58 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-fbf76682-5716-4809-b524-4068bd3bfe5c tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:09:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fbf76682-5716-4809-b524-4068bd3bfe5c tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:09:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fbf76682-5716-4809-b524-4068bd3bfe5c tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:09:58 devstack sudo[89425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:09:58 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:09:58 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root
Sep 16 16:09:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fbf76682-5716-4809-b524-4068bd3bfe5c tempest-VolumeRetypeWithoutMigrationTest-145164656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.429s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:09:58 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-fbf76682-5716-4809-b524-4068bd3bfe5c tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:09:58 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-fbf76682-5716-4809-b524-4068bd3bfe5c tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Deleted volume successfully.
Sep 16 16:09:58 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fbf76682-5716-4809-b524-4068bd3bfe5c tempest-VolumeRetypeWithoutMigrationTest-145164656 None] Lock "cinder-b9861ae6-f91e-40fe-a4de-111216b6e4d1-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:10:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:10:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:10:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:10:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:10:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:10:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:10:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:07 devstack sudo[89453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:10:07 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:07 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.413s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:10:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:10:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 8 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:10:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:10:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-102c09d0-1f7c-48f9-b6c0-8ccd72e25455 req-fbb4fedb-c0a7-4c89-b48d-5226811b4326 tempest-AttachVolumeShelveTestJSON-1437213778 None] No connector for attachment a56a092e-f165-41ea-91be-7fd0298d891a; skipping storage backend terminate_connection call. {{(pid=86165) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 16 16:10:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-102c09d0-1f7c-48f9-b6c0-8ccd72e25455 req-fbb4fedb-c0a7-4c89-b48d-5226811b4326 tempest-AttachVolumeShelveTestJSON-1437213778 None] Deleting attachment a56a092e-f165-41ea-91be-7fd0298d891a. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:10:17 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=18,cinder:UPDATE=22,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:10:17 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=15,cinder:SELECT=16,cinder:DELETE=2,cinder:INSERT=3 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:10:22 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:10:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Flow 'volume_create_manager' (416a6b1d-972f-4737-8f4b-005d7e373e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:10:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636be514-1353-43e1-93ee-7fde2aeb61d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636be514-1353-43e1-93ee-7fde2aeb61d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1886085361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ff05f7-6b4d-41be-bd52-60375f32e96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd80dbaaaf542c0b6d47423fc8aa7a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:22Z,use_quota=True,user_id='62ade464ae1545eeb718c42520fb9787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b366a9a-ea3c-4f67-afdc-3511be1fbb3a),volume_type_id=2b366a9a-ea3c-4f67-afdc-3511be1fbb3a)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93afaca-9bc8-4458-93f8-deb499f83cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93afaca-9bc8-4458-93f8-deb499f83cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562084c8-485f-4bd3-bb7e-a77ebb04f099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562084c8-485f-4bd3-bb7e-a77ebb04f099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77ff05f7-6b4d-41be-bd52-60375f32e96e', 'volume_name': 'volume-77ff05f7-6b4d-41be-bd52-60375f32e96e', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8ca5754-31ef-4a7a-bb02-173db9ee8f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8ca5754-31ef-4a7a-bb02-173db9ee8f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d2c252-0b14-4ba8-8478-efc6adee8bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:22 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Volume 77ff05f7-6b4d-41be-bd52-60375f32e96e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77ff05f7-6b4d-41be-bd52-60375f32e96e', 'volume_size': 1}
Sep 16 16:10:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:10:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:10:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1886085361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ff05f7-6b4d-41be-bd52-60375f32e96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd80dbaaaf542c0b6d47423fc8aa7a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:22Z,use_quota=True,user_id='62ade464ae1545eeb718c42520fb9787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b366a9a-ea3c-4f67-afdc-3511be1fbb3a),volume_type_id=2b366a9a-ea3c-4f67-afdc-3511be1fbb3a)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:10:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Creating volume 77ff05f7-6b4d-41be-bd52-60375f32e96e {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:10:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:10:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:10:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:10:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:10:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:10:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:10:22 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:10:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77ff05f7-6b4d-41be-bd52-60375f32e96e 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:22 devstack sudo[89687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77ff05f7-6b4d-41be-bd52-60375f32e96e 1073741824
Sep 16 16:10:22 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:23 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77ff05f7-6b4d-41be-bd52-60375f32e96e 1073741824" returned: 0 in 0.989s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77ff05f7-6b4d-41be-bd52-60375f32e96e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:24 devstack sudo[89695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77ff05f7-6b4d-41be-bd52-60375f32e96e
Sep 16 16:10:24 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:24 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77ff05f7-6b4d-41be-bd52-60375f32e96e" returned: 0 in 0.456s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:24 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:10:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:10:24 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4d2c252-0b14-4ba8-8478-efc6adee8bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77ff05f7-6b4d-41be-bd52-60375f32e96e', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:24 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafb1179-b320-4048-87cb-d3f3640ac7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:24 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Volume volume-77ff05f7-6b4d-41be-bd52-60375f32e96e (77ff05f7-6b4d-41be-bd52-60375f32e96e): created successfully
Sep 16 16:10:24 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafb1179-b320-4048-87cb-d3f3640ac7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:24 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Flow 'volume_create_manager' (416a6b1d-972f-4737-8f4b-005d7e373e7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:10:24 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-647ce050-978f-4fdf-a43b-da99ab46f2e1 tempest-VolumeTypesAccessTest-998401737 None] Created volume successfully.
Sep 16 16:10:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-066edea7-c15f-42ea-88b9-6eec2dd70151 tempest-VolumeTypesAccessTest-998401737 None] Acquiring lock "cinder-77ff05f7-6b4d-41be-bd52-60375f32e96e-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:10:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-066edea7-c15f-42ea-88b9-6eec2dd70151 tempest-VolumeTypesAccessTest-998401737 None] Lock "cinder-77ff05f7-6b4d-41be-bd52-60375f32e96e-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:10:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-066edea7-c15f-42ea-88b9-6eec2dd70151 tempest-VolumeTypesAccessTest-998401737 None] Acquiring lock "cinder-quobyte-77ff05f7-6b4d-41be-bd52-60375f32e96e" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:10:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-066edea7-c15f-42ea-88b9-6eec2dd70151 tempest-VolumeTypesAccessTest-998401737 None] Lock "cinder-quobyte-77ff05f7-6b4d-41be-bd52-60375f32e96e" acquired by "delete_volume" :: waited 0.055s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:10:26 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b241104f-3f14-49d4-975f-b926d897f000]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:10:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-066edea7-c15f-42ea-88b9-6eec2dd70151 tempest-VolumeTypesAccessTest-998401737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77ff05f7-6b4d-41be-bd52-60375f32e96e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:27 devstack sudo[89758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77ff05f7-6b4d-41be-bd52-60375f32e96e
Sep 16 16:10:27 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:28 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-066edea7-c15f-42ea-88b9-6eec2dd70151 tempest-VolumeTypesAccessTest-998401737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77ff05f7-6b4d-41be-bd52-60375f32e96e" returned: 0 in 1.297s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-066edea7-c15f-42ea-88b9-6eec2dd70151 tempest-VolumeTypesAccessTest-998401737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77ff05f7-6b4d-41be-bd52-60375f32e96e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:28 devstack sudo[89777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77ff05f7-6b4d-41be-bd52-60375f32e96e
Sep 16 16:10:28 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:28 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-066edea7-c15f-42ea-88b9-6eec2dd70151 tempest-VolumeTypesAccessTest-998401737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77ff05f7-6b4d-41be-bd52-60375f32e96e" returned: 0 in 0.542s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-066edea7-c15f-42ea-88b9-6eec2dd70151 tempest-VolumeTypesAccessTest-998401737 None] Lock "cinder-quobyte-77ff05f7-6b4d-41be-bd52-60375f32e96e" released by "delete_volume" :: held 1.972s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:10:28 devstack cinder-volume[86165]: WARNING cinder.quota [None req-066edea7-c15f-42ea-88b9-6eec2dd70151 tempest-VolumeTypesAccessTest-998401737 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1391807423 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1391807423, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:10:28 devstack cinder-volume[86165]: WARNING cinder.quota [None req-066edea7-c15f-42ea-88b9-6eec2dd70151 tempest-VolumeTypesAccessTest-998401737 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1391807423 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1391807423, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:10:28 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-066edea7-c15f-42ea-88b9-6eec2dd70151 tempest-VolumeTypesAccessTest-998401737 None] Created reservations ['eb77fffe-79cc-4db4-bc20-093224d51496', '0d0d508f-530f-4eb2-b50f-e3b56a780788', '1ce5db82-f894-4127-a1a4-5fb5a5c8fc9c', '49a201ff-8578-49e9-961b-244c9ed0f1ca'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:10:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-066edea7-c15f-42ea-88b9-6eec2dd70151 tempest-VolumeTypesAccessTest-998401737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:10:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-066edea7-c15f-42ea-88b9-6eec2dd70151 tempest-VolumeTypesAccessTest-998401737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:10:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-066edea7-c15f-42ea-88b9-6eec2dd70151 tempest-VolumeTypesAccessTest-998401737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:10:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-066edea7-c15f-42ea-88b9-6eec2dd70151 tempest-VolumeTypesAccessTest-998401737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:10:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-066edea7-c15f-42ea-88b9-6eec2dd70151 tempest-VolumeTypesAccessTest-998401737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:10:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-066edea7-c15f-42ea-88b9-6eec2dd70151 tempest-VolumeTypesAccessTest-998401737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:29 devstack sudo[89783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:10:29 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:29 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-066edea7-c15f-42ea-88b9-6eec2dd70151 tempest-VolumeTypesAccessTest-998401737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.477s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:29 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-066edea7-c15f-42ea-88b9-6eec2dd70151 tempest-VolumeTypesAccessTest-998401737 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:10:29 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-066edea7-c15f-42ea-88b9-6eec2dd70151 tempest-VolumeTypesAccessTest-998401737 None] Deleted volume successfully.
Sep 16 16:10:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-066edea7-c15f-42ea-88b9-6eec2dd70151 tempest-VolumeTypesAccessTest-998401737 None] Lock "cinder-77ff05f7-6b4d-41be-bd52-60375f32e96e-delete_volume" released by "delete_volume" :: held 3.342s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:10:39 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=8,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:10:39 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=6,cinder:UPDATE=12,cinder:DELETE=2,cinder:INSERT=3 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Flow 'volume_create_manager' (0cff200a-ab99-43e8-b170-39166ff3387c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3692cfdf-68b3-4a6c-ab7e-1bf14fc3f061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3692cfdf-68b3-4a6c-ab7e-1bf14fc3f061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1938729500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=712d6bbe-d888-480c-b3cb-829d3443bb70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5e97ab045141999a104bda59df0a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:44Z,use_quota=True,user_id='a1c5751f3bd7454e9fe345156418ca2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b844a500-2698-420c-a036-9b4d0357a134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b844a500-2698-420c-a036-9b4d0357a134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f35f5f-1c62-4eab-bcbb-daae98fc5379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f35f5f-1c62-4eab-bcbb-daae98fc5379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '712d6bbe-d888-480c-b3cb-829d3443bb70', 'volume_name': 'volume-712d6bbe-d888-480c-b3cb-829d3443bb70', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531a02f5-c831-4952-b9a8-6cd8e4032761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531a02f5-c831-4952-b9a8-6cd8e4032761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e96b4371-fc39-462c-bf3b-34731d51ef0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:44 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Volume 712d6bbe-d888-480c-b3cb-829d3443bb70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-712d6bbe-d888-480c-b3cb-829d3443bb70', 'volume_size': 1}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1938729500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=712d6bbe-d888-480c-b3cb-829d3443bb70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5e97ab045141999a104bda59df0a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:44Z,use_quota=True,user_id='a1c5751f3bd7454e9fe345156418ca2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Creating volume 712d6bbe-d888-480c-b3cb-829d3443bb70 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:10:44 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-712d6bbe-d888-480c-b3cb-829d3443bb70 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:44 devstack sudo[89976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-712d6bbe-d888-480c-b3cb-829d3443bb70 1073741824
Sep 16 16:10:44 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Flow 'volume_create_manager' (4c746b71-c864-4ba4-bee8-97a7cc501d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d3135d-3162-41e5-b0c2-1a829ef0f9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d3135d-3162-41e5-b0c2-1a829ef0f9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1246856723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f854ec-32b0-44d9-ab86-4e401fe45a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d982ffb76174695967ceba04d4ae04f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:45Z,use_quota=True,user_id='1cc5126e6954427eaf92b8804fe7bd51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e09a34-b6c5-4bd4-b3d3-f5eaa8ac298c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e09a34-b6c5-4bd4-b3d3-f5eaa8ac298c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22005843-b81f-4c4d-9105-d9c61316eb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22005843-b81f-4c4d-9105-d9c61316eb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26f854ec-32b0-44d9-ab86-4e401fe45a97', 'volume_name': 'volume-26f854ec-32b0-44d9-ab86-4e401fe45a97', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5abca8-6759-4993-9387-861bc7201b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5abca8-6759-4993-9387-861bc7201b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:44 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8365f031-f4b7-4a2b-9252-4bfbf799e012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:44 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Volume 26f854ec-32b0-44d9-ab86-4e401fe45a97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26f854ec-32b0-44d9-ab86-4e401fe45a97', 'volume_size': 1}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-712d6bbe-d888-480c-b3cb-829d3443bb70 1073741824" returned: 0 in 0.521s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-712d6bbe-d888-480c-b3cb-829d3443bb70 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:44 devstack sudo[89981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-712d6bbe-d888-480c-b3cb-829d3443bb70
Sep 16 16:10:44 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:45 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-712d6bbe-d888-480c-b3cb-829d3443bb70" returned: 0 in 0.245s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:10:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:10:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.279s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:10:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1246856723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f854ec-32b0-44d9-ab86-4e401fe45a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d982ffb76174695967ceba04d4ae04f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:45Z,use_quota=True,user_id='1cc5126e6954427eaf92b8804fe7bd51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:10:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Creating volume 26f854ec-32b0-44d9-ab86-4e401fe45a97 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:10:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:10:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:10:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:10:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:10:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:10:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:10:45 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:10:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-26f854ec-32b0-44d9-ab86-4e401fe45a97 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e96b4371-fc39-462c-bf3b-34731d51ef0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-712d6bbe-d888-480c-b3cb-829d3443bb70', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:45 devstack sudo[89984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-26f854ec-32b0-44d9-ab86-4e401fe45a97 1073741824
Sep 16 16:10:45 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4315d05a-ff9a-4683-bd7a-164dd74e234d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:45 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Volume volume-712d6bbe-d888-480c-b3cb-829d3443bb70 (712d6bbe-d888-480c-b3cb-829d3443bb70): created successfully
Sep 16 16:10:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4315d05a-ff9a-4683-bd7a-164dd74e234d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Flow 'volume_create_manager' (0cff200a-ab99-43e8-b170-39166ff3387c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:10:45 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-e55b12b4-d061-456b-b806-cb0f612f8822 tempest-ServersNegativeTestJSON-198586918 None] Created volume successfully.
Sep 16 16:10:45 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-26f854ec-32b0-44d9-ab86-4e401fe45a97 1073741824" returned: 0 in 0.492s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-26f854ec-32b0-44d9-ab86-4e401fe45a97 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:45 devstack sudo[89991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-26f854ec-32b0-44d9-ab86-4e401fe45a97
Sep 16 16:10:45 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:45 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-26f854ec-32b0-44d9-ab86-4e401fe45a97" returned: 0 in 0.256s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:10:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8365f031-f4b7-4a2b-9252-4bfbf799e012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f854ec-32b0-44d9-ab86-4e401fe45a97', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08938a1-1d78-4e6e-9851-596fdef3d25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:46 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Volume volume-26f854ec-32b0-44d9-ab86-4e401fe45a97 (26f854ec-32b0-44d9-ab86-4e401fe45a97): created successfully
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08938a1-1d78-4e6e-9851-596fdef3d25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Flow 'volume_create_manager' (4c746b71-c864-4ba4-bee8-97a7cc501d69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:10:46 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b1b2a8f0-fa27-4aad-8065-fbcac69cfae3 tempest-AbsoluteLimitsTests-2027710455 None] Created volume successfully.
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Flow 'volume_create_manager' (e5c80281-8957-4729-829e-5d66910db1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e17555a6-c850-4127-9847-5d5bd84e5c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e17555a6-c850-4127-9847-5d5bd84e5c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2040811852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08111cd9824d48fbb9e859dc93b4ea1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:46Z,use_quota=True,user_id='107b9507e0f64b7bb34153b40debaf57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c0a5bd-d28f-4cbc-8f91-f580d40e7aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c0a5bd-d28f-4cbc-8f91-f580d40e7aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4a2977-c835-48d9-8d2c-7bca248c0d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4a2977-c835-48d9-8d2c-7bca248c0d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5', 'volume_name': 'volume-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c52e01-6512-4837-8d35-320e104a4711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c52e01-6512-4837-8d35-320e104a4711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04283315-21db-4be4-a5e0-07c547672a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:46 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Volume eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5', 'volume_size': 1}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2040811852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08111cd9824d48fbb9e859dc93b4ea1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:46Z,use_quota=True,user_id='107b9507e0f64b7bb34153b40debaf57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Creating volume eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:10:46 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:10:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:46 devstack sudo[89994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5 1073741824
Sep 16 16:10:46 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:47 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b02a9af6-1acc-4ff4-8bff-573d32bf938a tempest-AbsoluteLimitsTests-2027710455 None] Acquiring lock "cinder-26f854ec-32b0-44d9-ab86-4e401fe45a97-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:10:47 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:47 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b02a9af6-1acc-4ff4-8bff-573d32bf938a tempest-AbsoluteLimitsTests-2027710455 None] Lock "cinder-26f854ec-32b0-44d9-ab86-4e401fe45a97-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:10:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5 1073741824" returned: 0 in 0.794s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:47 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b02a9af6-1acc-4ff4-8bff-573d32bf938a tempest-AbsoluteLimitsTests-2027710455 None] Acquiring lock "cinder-quobyte-26f854ec-32b0-44d9-ab86-4e401fe45a97" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:10:47 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b02a9af6-1acc-4ff4-8bff-573d32bf938a tempest-AbsoluteLimitsTests-2027710455 None] Lock "cinder-quobyte-26f854ec-32b0-44d9-ab86-4e401fe45a97" acquired by "delete_volume" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:10:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:47 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f522d69-5941-47aa-92ec-d600039380cb]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:10:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b02a9af6-1acc-4ff4-8bff-573d32bf938a tempest-AbsoluteLimitsTests-2027710455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-26f854ec-32b0-44d9-ab86-4e401fe45a97 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:47 devstack sudo[90001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5
Sep 16 16:10:47 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:47 devstack sudo[90003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-26f854ec-32b0-44d9-ab86-4e401fe45a97
Sep 16 16:10:47 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:48 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5" returned: 0 in 0.498s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04283315-21db-4be4-a5e0-07c547672a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b6a1632-3d39-4b33-8d57-cd1b6757cd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:48 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Volume volume-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5 (eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5): created successfully
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b6a1632-3d39-4b33-8d57-cd1b6757cd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Flow 'volume_create_manager' (e5c80281-8957-4729-829e-5d66910db1c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:10:48 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-f07614b4-97e2-4611-8765-0ebe0276bfd8 tempest-ServerActionsTestOtherA-2007622607 None] Created volume successfully.
Sep 16 16:10:48 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b02a9af6-1acc-4ff4-8bff-573d32bf938a tempest-AbsoluteLimitsTests-2027710455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-26f854ec-32b0-44d9-ab86-4e401fe45a97" returned: 0 in 0.584s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b02a9af6-1acc-4ff4-8bff-573d32bf938a tempest-AbsoluteLimitsTests-2027710455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-26f854ec-32b0-44d9-ab86-4e401fe45a97 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:48 devstack sudo[90010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-26f854ec-32b0-44d9-ab86-4e401fe45a97
Sep 16 16:10:48 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Flow 'volume_create_manager' (91d95ee8-d03e-442d-99c2-c6f10bac7882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52187f0-4f70-4f4f-b6a0-744c092e6324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52187f0-4f70-4f4f-b6a0-744c092e6324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1485588775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03aee921-5d5c-4807-abef-b920d0cc1f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5e97ab045141999a104bda59df0a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:48Z,use_quota=True,user_id='a1c5751f3bd7454e9fe345156418ca2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e18369-b801-4613-9f3b-977cb251dc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e18369-b801-4613-9f3b-977cb251dc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b26437-5769-4e95-a121-2ecae928c23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b26437-5769-4e95-a121-2ecae928c23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03aee921-5d5c-4807-abef-b920d0cc1f00', 'volume_name': 'volume-03aee921-5d5c-4807-abef-b920d0cc1f00', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9550ae3-b851-4e72-825f-edb3325bf8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9550ae3-b851-4e72-825f-edb3325bf8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7e820b-ceff-4891-9d50-cf3dc92f8f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:48 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Volume 03aee921-5d5c-4807-abef-b920d0cc1f00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03aee921-5d5c-4807-abef-b920d0cc1f00', 'volume_size': 1}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1485588775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03aee921-5d5c-4807-abef-b920d0cc1f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5e97ab045141999a104bda59df0a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:48Z,use_quota=True,user_id='a1c5751f3bd7454e9fe345156418ca2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Creating volume 03aee921-5d5c-4807-abef-b920d0cc1f00 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:10:48 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-03aee921-5d5c-4807-abef-b920d0cc1f00 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:48 devstack sudo[90012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-03aee921-5d5c-4807-abef-b920d0cc1f00 1073741824
Sep 16 16:10:48 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:48 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b02a9af6-1acc-4ff4-8bff-573d32bf938a tempest-AbsoluteLimitsTests-2027710455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-26f854ec-32b0-44d9-ab86-4e401fe45a97" returned: 0 in 0.256s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b02a9af6-1acc-4ff4-8bff-573d32bf938a tempest-AbsoluteLimitsTests-2027710455 None] Lock "cinder-quobyte-26f854ec-32b0-44d9-ab86-4e401fe45a97" released by "delete_volume" :: held 0.926s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-b02a9af6-1acc-4ff4-8bff-573d32bf938a tempest-AbsoluteLimitsTests-2027710455 None] Created reservations ['12eeedc1-9dbd-4f0a-9d9e-64b9d7c82bae', 'e47bf7ef-9862-4655-99dc-23a96153ae50', 'f305396f-da61-4510-a96e-89ac0d11d755', 'd6495420-1a30-4ffe-b68d-6c7c35cda4dd'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b02a9af6-1acc-4ff4-8bff-573d32bf938a tempest-AbsoluteLimitsTests-2027710455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b02a9af6-1acc-4ff4-8bff-573d32bf938a tempest-AbsoluteLimitsTests-2027710455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b02a9af6-1acc-4ff4-8bff-573d32bf938a tempest-AbsoluteLimitsTests-2027710455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b02a9af6-1acc-4ff4-8bff-573d32bf938a tempest-AbsoluteLimitsTests-2027710455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b02a9af6-1acc-4ff4-8bff-573d32bf938a tempest-AbsoluteLimitsTests-2027710455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b02a9af6-1acc-4ff4-8bff-573d32bf938a tempest-AbsoluteLimitsTests-2027710455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:48 devstack sudo[90017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:10:48 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:48 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b02a9af6-1acc-4ff4-8bff-573d32bf938a tempest-AbsoluteLimitsTests-2027710455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.355s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-b02a9af6-1acc-4ff4-8bff-573d32bf938a tempest-AbsoluteLimitsTests-2027710455 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:10:48 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b02a9af6-1acc-4ff4-8bff-573d32bf938a tempest-AbsoluteLimitsTests-2027710455 None] Deleted volume successfully.
Sep 16 16:10:48 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-03aee921-5d5c-4807-abef-b920d0cc1f00 1073741824" returned: 0 in 0.642s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:49 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b02a9af6-1acc-4ff4-8bff-573d32bf938a tempest-AbsoluteLimitsTests-2027710455 None] Lock "cinder-26f854ec-32b0-44d9-ab86-4e401fe45a97-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:10:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-03aee921-5d5c-4807-abef-b920d0cc1f00 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:49 devstack sudo[90022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-03aee921-5d5c-4807-abef-b920d0cc1f00
Sep 16 16:10:49 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:49 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-03aee921-5d5c-4807-abef-b920d0cc1f00" returned: 0 in 0.437s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:10:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:10:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7e820b-ceff-4891-9d50-cf3dc92f8f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03aee921-5d5c-4807-abef-b920d0cc1f00', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2419fc-5035-47bd-974a-d03ddc973926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:49 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Volume volume-03aee921-5d5c-4807-abef-b920d0cc1f00 (03aee921-5d5c-4807-abef-b920d0cc1f00): created successfully
Sep 16 16:10:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2419fc-5035-47bd-974a-d03ddc973926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Flow 'volume_create_manager' (91d95ee8-d03e-442d-99c2-c6f10bac7882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:10:49 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-92eaccfc-1d25-400f-8167-e66f741bda3a tempest-ServersNegativeTestJSON-198586918 None] Created volume successfully.
Sep 16 16:10:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-471dd7de-4216-41fe-8742-8f5aede0988b tempest-ServersNegativeTestJSON-198586918 None] Acquiring lock "cinder-03aee921-5d5c-4807-abef-b920d0cc1f00-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:10:51 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-471dd7de-4216-41fe-8742-8f5aede0988b tempest-ServersNegativeTestJSON-198586918 None] Lock "cinder-03aee921-5d5c-4807-abef-b920d0cc1f00-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:10:51 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-471dd7de-4216-41fe-8742-8f5aede0988b tempest-ServersNegativeTestJSON-198586918 None] Acquiring lock "cinder-quobyte-03aee921-5d5c-4807-abef-b920d0cc1f00" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:10:51 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-471dd7de-4216-41fe-8742-8f5aede0988b tempest-ServersNegativeTestJSON-198586918 None] Lock "cinder-quobyte-03aee921-5d5c-4807-abef-b920d0cc1f00" acquired by "delete_volume" :: waited 0.030s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:10:51 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f0067a-afd3-4838-b923-3986f51ac400]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:10:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-471dd7de-4216-41fe-8742-8f5aede0988b tempest-ServersNegativeTestJSON-198586918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-03aee921-5d5c-4807-abef-b920d0cc1f00 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:51 devstack sudo[90030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-03aee921-5d5c-4807-abef-b920d0cc1f00
Sep 16 16:10:51 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:51 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-471dd7de-4216-41fe-8742-8f5aede0988b tempest-ServersNegativeTestJSON-198586918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-03aee921-5d5c-4807-abef-b920d0cc1f00" returned: 0 in 0.469s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-471dd7de-4216-41fe-8742-8f5aede0988b tempest-ServersNegativeTestJSON-198586918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-03aee921-5d5c-4807-abef-b920d0cc1f00 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:51 devstack sudo[90037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-03aee921-5d5c-4807-abef-b920d0cc1f00
Sep 16 16:10:51 devstack sudo[90037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:51 devstack sudo[90037]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-471dd7de-4216-41fe-8742-8f5aede0988b tempest-ServersNegativeTestJSON-198586918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-03aee921-5d5c-4807-abef-b920d0cc1f00" returned: 0 in 0.323s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:51 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-471dd7de-4216-41fe-8742-8f5aede0988b tempest-ServersNegativeTestJSON-198586918 None] Lock "cinder-quobyte-03aee921-5d5c-4807-abef-b920d0cc1f00" released by "delete_volume" :: held 0.859s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:10:52 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-471dd7de-4216-41fe-8742-8f5aede0988b tempest-ServersNegativeTestJSON-198586918 None] Created reservations ['d3ebf996-908d-4913-8d6a-fad9877ef5ed', 'da02f18d-d26d-4671-924b-177cd0b16e0e', '11709aee-cb0c-460e-879c-8287a18e5997', 'cae08103-cac7-40eb-adb4-af45c027d77d'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:10:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-471dd7de-4216-41fe-8742-8f5aede0988b tempest-ServersNegativeTestJSON-198586918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:10:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-471dd7de-4216-41fe-8742-8f5aede0988b tempest-ServersNegativeTestJSON-198586918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:10:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-471dd7de-4216-41fe-8742-8f5aede0988b tempest-ServersNegativeTestJSON-198586918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:10:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-471dd7de-4216-41fe-8742-8f5aede0988b tempest-ServersNegativeTestJSON-198586918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:10:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-471dd7de-4216-41fe-8742-8f5aede0988b tempest-ServersNegativeTestJSON-198586918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:10:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-471dd7de-4216-41fe-8742-8f5aede0988b tempest-ServersNegativeTestJSON-198586918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:52 devstack sudo[90040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:10:52 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:52 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-471dd7de-4216-41fe-8742-8f5aede0988b tempest-ServersNegativeTestJSON-198586918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.323s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:52 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-471dd7de-4216-41fe-8742-8f5aede0988b tempest-ServersNegativeTestJSON-198586918 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:10:52 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-471dd7de-4216-41fe-8742-8f5aede0988b tempest-ServersNegativeTestJSON-198586918 None] Deleted volume successfully.
Sep 16 16:10:52 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-471dd7de-4216-41fe-8742-8f5aede0988b tempest-ServersNegativeTestJSON-198586918 None] Lock "cinder-03aee921-5d5c-4807-abef-b920d0cc1f00-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:10:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-50fe1515-95de-4988-9b85-f5508a6f8c56 tempest-ServersNegativeTestJSON-198586918 None] Acquiring lock "cinder-712d6bbe-d888-480c-b3cb-829d3443bb70-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:10:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-50fe1515-95de-4988-9b85-f5508a6f8c56 tempest-ServersNegativeTestJSON-198586918 None] Lock "cinder-712d6bbe-d888-480c-b3cb-829d3443bb70-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:10:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-50fe1515-95de-4988-9b85-f5508a6f8c56 tempest-ServersNegativeTestJSON-198586918 None] Acquiring lock "cinder-quobyte-712d6bbe-d888-480c-b3cb-829d3443bb70" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:10:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-50fe1515-95de-4988-9b85-f5508a6f8c56 tempest-ServersNegativeTestJSON-198586918 None] Lock "cinder-quobyte-712d6bbe-d888-480c-b3cb-829d3443bb70" acquired by "delete_volume" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:10:53 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[991433ec-0b30-43e8-8d17-941756b29177]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:10:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-50fe1515-95de-4988-9b85-f5508a6f8c56 tempest-ServersNegativeTestJSON-198586918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-712d6bbe-d888-480c-b3cb-829d3443bb70 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:53 devstack sudo[90059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-712d6bbe-d888-480c-b3cb-829d3443bb70
Sep 16 16:10:53 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:53 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-50fe1515-95de-4988-9b85-f5508a6f8c56 tempest-ServersNegativeTestJSON-198586918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-712d6bbe-d888-480c-b3cb-829d3443bb70" returned: 0 in 0.470s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-50fe1515-95de-4988-9b85-f5508a6f8c56 tempest-ServersNegativeTestJSON-198586918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-712d6bbe-d888-480c-b3cb-829d3443bb70 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:53 devstack sudo[90098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-712d6bbe-d888-480c-b3cb-829d3443bb70
Sep 16 16:10:53 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:54 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-50fe1515-95de-4988-9b85-f5508a6f8c56 tempest-ServersNegativeTestJSON-198586918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-712d6bbe-d888-480c-b3cb-829d3443bb70" returned: 0 in 0.604s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-50fe1515-95de-4988-9b85-f5508a6f8c56 tempest-ServersNegativeTestJSON-198586918 None] Lock "cinder-quobyte-712d6bbe-d888-480c-b3cb-829d3443bb70" released by "delete_volume" :: held 1.158s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:10:54 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-50fe1515-95de-4988-9b85-f5508a6f8c56 tempest-ServersNegativeTestJSON-198586918 None] Created reservations ['ebcff939-694c-4de0-a9a2-0f290abeb726', '4ffc875c-fca5-415f-86bd-fbfb99d5cda2', 'c8bc6fac-f5e4-4d38-90d2-d21f84a4ebf9', '35cafdca-2586-4e73-9922-40d1bfc8630b'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:10:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-50fe1515-95de-4988-9b85-f5508a6f8c56 tempest-ServersNegativeTestJSON-198586918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:10:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-50fe1515-95de-4988-9b85-f5508a6f8c56 tempest-ServersNegativeTestJSON-198586918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:10:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-50fe1515-95de-4988-9b85-f5508a6f8c56 tempest-ServersNegativeTestJSON-198586918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:10:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-50fe1515-95de-4988-9b85-f5508a6f8c56 tempest-ServersNegativeTestJSON-198586918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:10:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-50fe1515-95de-4988-9b85-f5508a6f8c56 tempest-ServersNegativeTestJSON-198586918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:10:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-50fe1515-95de-4988-9b85-f5508a6f8c56 tempest-ServersNegativeTestJSON-198586918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:54 devstack sudo[90103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:10:54 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:55 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-50fe1515-95de-4988-9b85-f5508a6f8c56 tempest-ServersNegativeTestJSON-198586918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.382s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-50fe1515-95de-4988-9b85-f5508a6f8c56 tempest-ServersNegativeTestJSON-198586918 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:10:55 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-50fe1515-95de-4988-9b85-f5508a6f8c56 tempest-ServersNegativeTestJSON-198586918 None] Deleted volume successfully.
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-50fe1515-95de-4988-9b85-f5508a6f8c56 tempest-ServersNegativeTestJSON-198586918 None] Lock "cinder-712d6bbe-d888-480c-b3cb-829d3443bb70-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Flow 'volume_create_manager' (3ded5a6a-3e3c-454c-b958-a4e6659cae1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d96710b8-4412-4888-87f0-a7806cc8b129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d96710b8-4412-4888-87f0-a7806cc8b129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1815377014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac259161-83e2-4050-bd75-06112933c920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7046f9da8f18493eb12edd90a9a5b270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:55Z,use_quota=True,user_id='2223923c748343e0a0a251b1f116cca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394056ba-580a-4279-b386-65fb223f7c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394056ba-580a-4279-b386-65fb223f7c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede3b857-1604-4fa6-9415-a262830c2c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede3b857-1604-4fa6-9415-a262830c2c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac259161-83e2-4050-bd75-06112933c920', 'volume_name': 'volume-ac259161-83e2-4050-bd75-06112933c920', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c5b942-d842-49f5-91f6-08527cc6ff13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c5b942-d842-49f5-91f6-08527cc6ff13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd362d9-b79d-4942-9f9d-d5e6ebad2015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:55 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Volume ac259161-83e2-4050-bd75-06112933c920: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac259161-83e2-4050-bd75-06112933c920', 'volume_size': 1}
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1815377014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac259161-83e2-4050-bd75-06112933c920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7046f9da8f18493eb12edd90a9a5b270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:55Z,use_quota=True,user_id='2223923c748343e0a0a251b1f116cca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Creating volume ac259161-83e2-4050-bd75-06112933c920 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:10:55 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:10:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:55 devstack sudo[90106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920 1073741824
Sep 16 16:10:55 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:56 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920 1073741824" returned: 0 in 0.653s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:56 devstack sudo[90115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920
Sep 16 16:10:56 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:56 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920" returned: 0 in 0.468s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:10:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:10:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd362d9-b79d-4942-9f9d-d5e6ebad2015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac259161-83e2-4050-bd75-06112933c920', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb01736e-ceb9-4855-a742-4676f945fe82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:10:56 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Volume volume-ac259161-83e2-4050-bd75-06112933c920 (ac259161-83e2-4050-bd75-06112933c920): created successfully
Sep 16 16:10:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb01736e-ceb9-4855-a742-4676f945fe82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:10:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Flow 'volume_create_manager' (3ded5a6a-3e3c-454c-b958-a4e6659cae1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:10:56 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-7321cd28-7ef2-4791-a2c7-9d4a242e9ce8 tempest-VolumesDeleteCascade-1506885483 None] Created volume successfully.
Sep 16 16:10:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-383b7985-f921-4068-9824-6789053874ee tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:10:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-383b7985-f921-4068-9824-6789053874ee tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:10:57 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-383b7985-f921-4068-9824-6789053874ee tempest-VolumesDeleteCascade-1506885483 None] Creating offline snapshot 0a5afe0a-b977-48a3-92a4-43546d3dd2d1 of volume ac259161-83e2-4050-bd75-06112933c920 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:10:57 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f1eaa5-f13b-4ca1-a6c7-f7bca2f6494e]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:10:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-383b7985-f921-4068-9824-6789053874ee tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:58 devstack sudo[90177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920
Sep 16 16:10:58 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:58 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-383b7985-f921-4068-9824-6789053874ee tempest-VolumesDeleteCascade-1506885483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920" returned: 0 in 0.604s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-383b7985-f921-4068-9824-6789053874ee tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:58 devstack sudo[90185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1 1G
Sep 16 16:10:58 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:59 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-383b7985-f921-4068-9824-6789053874ee tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1 1G" returned: 0 in 0.700s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-383b7985-f921-4068-9824-6789053874ee tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac259161-83e2-4050-bd75-06112933c920 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:59 devstack sudo[90193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac259161-83e2-4050-bd75-06112933c920 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1
Sep 16 16:10:59 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:59 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-383b7985-f921-4068-9824-6789053874ee tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac259161-83e2-4050-bd75-06112933c920 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1" returned: 0 in 0.359s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:59 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-383b7985-f921-4068-9824-6789053874ee tempest-VolumesDeleteCascade-1506885483 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1 is being set with open permissions: ugo+rw
Sep 16 16:10:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-383b7985-f921-4068-9824-6789053874ee tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:59 devstack sudo[90198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1
Sep 16 16:10:59 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:10:59 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root
Sep 16 16:10:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-383b7985-f921-4068-9824-6789053874ee tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1" returned: 0 in 0.263s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:10:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-383b7985-f921-4068-9824-6789053874ee tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:10:59 devstack sudo[90202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.info
Sep 16 16:10:59 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:00 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-383b7985-f921-4068-9824-6789053874ee tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.info" returned: 0 in 0.279s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:00 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-383b7985-f921-4068-9824-6789053874ee tempest-VolumesDeleteCascade-1506885483 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.info is being set with open permissions: ugo+rw
Sep 16 16:11:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-383b7985-f921-4068-9824-6789053874ee tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:00 devstack sudo[90206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.info
Sep 16 16:11:00 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:00 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-383b7985-f921-4068-9824-6789053874ee tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.info" returned: 0 in 0.271s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-383b7985-f921-4068-9824-6789053874ee tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.636s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:00 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-383b7985-f921-4068-9824-6789053874ee tempest-VolumesDeleteCascade-1506885483 None] Create snapshot completed successfully
Sep 16 16:11:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ad04bb58-46eb-46c1-b3a6-8e1f14eec12d tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ad04bb58-46eb-46c1-b3a6-8e1f14eec12d tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:01 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-ad04bb58-46eb-46c1-b3a6-8e1f14eec12d tempest-VolumesDeleteCascade-1506885483 None] Creating offline snapshot c093ccc6-92a5-46ed-8516-a08c226e32be of volume ac259161-83e2-4050-bd75-06112933c920 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:11:01 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e07f12c-1533-4602-8659-91e4de6becf4]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ad04bb58-46eb-46c1-b3a6-8e1f14eec12d tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:01 devstack sudo[90209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1
Sep 16 16:11:01 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:01 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ad04bb58-46eb-46c1-b3a6-8e1f14eec12d tempest-VolumesDeleteCascade-1506885483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1" returned: 0 in 0.513s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:01 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-ad04bb58-46eb-46c1-b3a6-8e1f14eec12d tempest-VolumesDeleteCascade-1506885483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac259161-83e2-4050-bd75-06112933c920(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:11:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ad04bb58-46eb-46c1-b3a6-8e1f14eec12d tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:01 devstack sudo[90216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be 1G
Sep 16 16:11:01 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:02 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ad04bb58-46eb-46c1-b3a6-8e1f14eec12d tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be 1G" returned: 0 in 0.637s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ad04bb58-46eb-46c1-b3a6-8e1f14eec12d tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:02 devstack sudo[90225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be
Sep 16 16:11:02 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:02 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ad04bb58-46eb-46c1-b3a6-8e1f14eec12d tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be" returned: 0 in 0.347s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:02 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-ad04bb58-46eb-46c1-b3a6-8e1f14eec12d tempest-VolumesDeleteCascade-1506885483 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be is being set with open permissions: ugo+rw
Sep 16 16:11:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ad04bb58-46eb-46c1-b3a6-8e1f14eec12d tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:02 devstack sudo[90231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be
Sep 16 16:11:02 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:03 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ad04bb58-46eb-46c1-b3a6-8e1f14eec12d tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be" returned: 0 in 0.243s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ad04bb58-46eb-46c1-b3a6-8e1f14eec12d tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:03 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-ad04bb58-46eb-46c1-b3a6-8e1f14eec12d tempest-VolumesDeleteCascade-1506885483 None] Create snapshot completed successfully
Sep 16 16:11:03 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "cinder-ac259161-83e2-4050-bd75-06112933c920-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:03 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-ac259161-83e2-4050-bd75-06112933c920-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:03 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Performing cascade delete. {{(pid=86165) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 16 16:11:03 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "cinder-0a5afe0a-b977-48a3-92a4-43546d3dd2d1-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:03 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-0a5afe0a-b977-48a3-92a4-43546d3dd2d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:03 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "cinder-quobyte-ac259161-83e2-4050-bd75-06112933c920" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:03 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-quobyte-ac259161-83e2-4050-bd75-06112933c920" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:03 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "cinder-quobyte-0a5afe0a-b977-48a3-92a4-43546d3dd2d1" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:03 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-quobyte-0a5afe0a-b977-48a3-92a4-43546d3dd2d1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:03 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Deleting offline snapshot 0a5afe0a-b977-48a3-92a4-43546d3dd2d1 of volume ac259161-83e2-4050-bd75-06112933c920 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:11:03 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] snapshot_file for this snap is: volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:11:03 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b42b0a-9bea-4ba1-88d8-32618913d122]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:03 devstack sudo[90234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1
Sep 16 16:11:03 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:04 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1" returned: 0 in 0.355s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:04 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac259161-83e2-4050-bd75-06112933c920(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:11:04 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f51f64-3c74-462f-ad0a-a2b3e65926ca]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:04 devstack sudo[90239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920
Sep 16 16:11:04 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:04 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920" returned: 0 in 0.529s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:04 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29620aa-a232-4afc-9006-3fb87bfcdb34]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:04 devstack sudo[90244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be
Sep 16 16:11:04 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:05 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be" returned: 0 in 0.378s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac259161-83e2-4050-bd75-06112933c920(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:11:05 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee533c6-f223-47c3-9294-5110f3690ae5]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:05 devstack sudo[90250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1
Sep 16 16:11:05 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:05 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1" returned: 0 in 0.450s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac259161-83e2-4050-bd75-06112933c920(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:11:05 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d65c35-04cb-44be-97dd-31abfd5e42e2]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:05 devstack sudo[90257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920
Sep 16 16:11:05 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:05 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920" returned: 0 in 0.428s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:05 devstack sudo[90262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1
Sep 16 16:11:05 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:06 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1" returned: 0 in 0.356s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:06 devstack sudo[90267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1
Sep 16 16:11:06 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:06 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.0a5afe0a-b977-48a3-92a4-43546d3dd2d1" returned: 0 in 0.283s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac259161-83e2-4050-bd75-06112933c920 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be -F qcow2 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:06 devstack sudo[90270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac259161-83e2-4050-bd75-06112933c920 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be -F qcow2
Sep 16 16:11:06 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:06 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac259161-83e2-4050-bd75-06112933c920 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be -F qcow2" returned: 0 in 0.317s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:06 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-quobyte-0a5afe0a-b977-48a3-92a4-43546d3dd2d1" released by "_delete_snapshot" :: held 3.335s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:06 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-quobyte-ac259161-83e2-4050-bd75-06112933c920" released by "delete_snapshot" :: held 3.359s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Created reservations ['c08adeb5-e3ef-4625-92d9-fe888102e8b4', '1e367f8c-a086-4ed5-b8c6-7192912ffd17', '6baef9bc-9089-49ac-a73f-06e1fedffbec', 'dfa3972a-94b2-40a9-b93e-30b3f981fd71'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:11:07 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Delete snapshot completed successfully.
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-0a5afe0a-b977-48a3-92a4-43546d3dd2d1-delete_snapshot" released by "delete_snapshot" :: held 3.547s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "cinder-c093ccc6-92a5-46ed-8516-a08c226e32be-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-c093ccc6-92a5-46ed-8516-a08c226e32be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "cinder-quobyte-ac259161-83e2-4050-bd75-06112933c920" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:07 devstack sudo[90276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:11:07 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-quobyte-ac259161-83e2-4050-bd75-06112933c920" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "cinder-quobyte-c093ccc6-92a5-46ed-8516-a08c226e32be" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-quobyte-c093ccc6-92a5-46ed-8516-a08c226e32be" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Deleting offline snapshot c093ccc6-92a5-46ed-8516-a08c226e32be of volume ac259161-83e2-4050-bd75-06112933c920 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] snapshot_file for this snap is: volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4c903e-5418-4446-bbc1-78edf419bc5c]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:07 devstack sudo[90278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be
Sep 16 16:11:07 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:07 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.372s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 8 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:11:07 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be" returned: 0 in 0.431s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac259161-83e2-4050-bd75-06112933c920(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a162a1e-af33-47dc-8dcb-dc4c72307599]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:07 devstack sudo[90284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920
Sep 16 16:11:07 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:08 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920" returned: 0 in 0.524s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:08 devstack sudo[90291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be
Sep 16 16:11:08 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:09 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be" returned: 0 in 0.835s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:09 devstack sudo[90319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be
Sep 16 16:11:09 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:09 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920.c093ccc6-92a5-46ed-8516-a08c226e32be" returned: 0 in 0.457s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-quobyte-c093ccc6-92a5-46ed-8516-a08c226e32be" released by "_delete_snapshot" :: held 2.402s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-quobyte-ac259161-83e2-4050-bd75-06112933c920" released by "delete_snapshot" :: held 2.434s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:09 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Created reservations ['a1dbdb0f-3ec2-4dfe-9669-ed5724efc2a1', '0bd6c346-cc76-47e3-a61c-a8799f11664e', '654a93a1-6592-44e4-a1e5-ca2ef95b599b', '38a4dd04-a0a2-49a3-a785-b2a5aa948495'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:11:09 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Delete snapshot completed successfully.
Sep 16 16:11:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-c093ccc6-92a5-46ed-8516-a08c226e32be-delete_snapshot" released by "delete_snapshot" :: held 2.682s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Snapshots deleted, issuing volume delete {{(pid=86165) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 16 16:11:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "cinder-quobyte-ac259161-83e2-4050-bd75-06112933c920" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-quobyte-ac259161-83e2-4050-bd75-06112933c920" acquired by "delete_volume" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:09 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[94092f5e-f564-4604-8e15-e78125bb6205]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:10 devstack sudo[90327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920
Sep 16 16:11:10 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:10 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920" returned: 0 in 0.600s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:10 devstack sudo[90335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920
Sep 16 16:11:10 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:10 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ac259161-83e2-4050-bd75-06112933c920" returned: 0 in 0.306s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:10 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-quobyte-ac259161-83e2-4050-bd75-06112933c920" released by "delete_volume" :: held 1.036s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:11 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Created reservations ['16d8af04-1877-4cbc-8d85-a1f5841cb425', '9c7b6500-1fc9-4529-9dc0-2b78bd547606', '68bf9d09-18de-4caa-83cc-71aa96b27a6c', '95aec472-beb0-4b1f-ace2-fb13a61f3ec3'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:11:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:11 devstack sudo[90359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:11:11 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:11 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.403s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:11 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:11:11 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Deleted volume successfully.
Sep 16 16:11:11 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20849ec2-47a1-4767-b7a2-e45adc845ae5 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-ac259161-83e2-4050-bd75-06112933c920-delete_volume" released by "delete_volume" :: held 8.209s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:12 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:11:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Flow 'volume_create_manager' (7b98afde-bdbf-433f-b7c2-32da4dd988a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:11:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964db8ec-7fd3-451c-ae4a-83f5b5177c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964db8ec-7fd3-451c-ae4a-83f5b5177c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1483236287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aac0769-5a1a-4f53-b4b3-32254f649bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7046f9da8f18493eb12edd90a9a5b270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:13Z,use_quota=True,user_id='2223923c748343e0a0a251b1f116cca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb0dfb4-16fc-456f-a2e3-6ca6f6562a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb0dfb4-16fc-456f-a2e3-6ca6f6562a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbd799ba-4dab-43a1-89eb-42983377477a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbd799ba-4dab-43a1-89eb-42983377477a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aac0769-5a1a-4f53-b4b3-32254f649bf9', 'volume_name': 'volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67854c61-ee67-4d04-8d25-095da6d389d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67854c61-ee67-4d04-8d25-095da6d389d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4852d8f-de14-443d-9d12-6073d0c35a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:12 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Volume 7aac0769-5a1a-4f53-b4b3-32254f649bf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9', 'volume_size': 1}
Sep 16 16:11:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1483236287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aac0769-5a1a-4f53-b4b3-32254f649bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7046f9da8f18493eb12edd90a9a5b270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:13Z,use_quota=True,user_id='2223923c748343e0a0a251b1f116cca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:11:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Creating volume 7aac0769-5a1a-4f53-b4b3-32254f649bf9 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:11:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:11:12 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:11:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:12 devstack sudo[90372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9 1073741824
Sep 16 16:11:12 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:13 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9 1073741824" returned: 0 in 0.495s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:13 devstack sudo[90378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9
Sep 16 16:11:13 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:13 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9" returned: 0 in 0.279s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:11:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4852d8f-de14-443d-9d12-6073d0c35a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a946bdfd-da8c-47e4-a53d-1dec8ea736e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:13 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Volume volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9 (7aac0769-5a1a-4f53-b4b3-32254f649bf9): created successfully
Sep 16 16:11:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a946bdfd-da8c-47e4-a53d-1dec8ea736e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Flow 'volume_create_manager' (7b98afde-bdbf-433f-b7c2-32da4dd988a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:11:13 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-eeba33a7-19b6-4593-ad0d-2637e15ada4c tempest-VolumesDeleteCascade-1506885483 None] Created volume successfully.
Sep 16 16:11:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-090dcaf6-fb60-442a-8462-7a4698d59d52 tempest-AttachVolumeShelveTestJSON-1437213778 None] Acquiring lock "cinder-c8832599-21f4-486b-b397-15c2209a80fa-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-090dcaf6-fb60-442a-8462-7a4698d59d52 tempest-AttachVolumeShelveTestJSON-1437213778 None] Lock "cinder-c8832599-21f4-486b-b397-15c2209a80fa-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-090dcaf6-fb60-442a-8462-7a4698d59d52 tempest-AttachVolumeShelveTestJSON-1437213778 None] Acquiring lock "cinder-quobyte-c8832599-21f4-486b-b397-15c2209a80fa" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-090dcaf6-fb60-442a-8462-7a4698d59d52 tempest-AttachVolumeShelveTestJSON-1437213778 None] Lock "cinder-quobyte-c8832599-21f4-486b-b397-15c2209a80fa" acquired by "delete_volume" :: waited 0.015s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:14 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ccf5ad-a58d-4bc2-8f10-5409501fd90f]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-090dcaf6-fb60-442a-8462-7a4698d59d52 tempest-AttachVolumeShelveTestJSON-1437213778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c8832599-21f4-486b-b397-15c2209a80fa {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:14 devstack sudo[90381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c8832599-21f4-486b-b397-15c2209a80fa
Sep 16 16:11:14 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:14 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-090dcaf6-fb60-442a-8462-7a4698d59d52 tempest-AttachVolumeShelveTestJSON-1437213778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c8832599-21f4-486b-b397-15c2209a80fa" returned: 0 in 0.378s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-090dcaf6-fb60-442a-8462-7a4698d59d52 tempest-AttachVolumeShelveTestJSON-1437213778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c8832599-21f4-486b-b397-15c2209a80fa {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:14 devstack sudo[90386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c8832599-21f4-486b-b397-15c2209a80fa
Sep 16 16:11:14 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c8563e18-e6ef-473e-9399-89ee761d5a6e tempest-BackendsCapabilitiesAdminTestsJSON-1556638625 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.9149932861328, 'free_capacity_gb': 1775.9149932861328, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86165) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 16 16:11:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-49a99894-dbce-48c0-886e-e04931dfa9f0 tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-49a99894-dbce-48c0-886e-e04931dfa9f0 tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-49a99894-dbce-48c0-886e-e04931dfa9f0 tempest-VolumesDeleteCascade-1506885483 None] Creating offline snapshot 3a216eb8-c878-4289-930d-f944d0c28156 of volume 7aac0769-5a1a-4f53-b4b3-32254f649bf9 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:11:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bc4363e-a186-41ad-a409-adf3ae72e45d tempest-BackendsCapabilitiesAdminTestsJSON-1556638625 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.9149932861328, 'free_capacity_gb': 1775.9149932861328, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86165) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 16 16:11:15 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11a4367-6652-45fb-831f-63bfa96aa49b]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-49a99894-dbce-48c0-886e-e04931dfa9f0 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:15 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-090dcaf6-fb60-442a-8462-7a4698d59d52 tempest-AttachVolumeShelveTestJSON-1437213778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c8832599-21f4-486b-b397-15c2209a80fa" returned: 0 in 0.309s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-090dcaf6-fb60-442a-8462-7a4698d59d52 tempest-AttachVolumeShelveTestJSON-1437213778 None] Lock "cinder-quobyte-c8832599-21f4-486b-b397-15c2209a80fa" released by "delete_volume" :: held 0.733s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:15 devstack sudo[90388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9
Sep 16 16:11:15 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:15 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-090dcaf6-fb60-442a-8462-7a4698d59d52 tempest-AttachVolumeShelveTestJSON-1437213778 None] Created reservations ['a562e5ba-bf40-4912-ad2a-bda371b7c865', '25fe615e-dda3-41bf-a371-be619fae0d9d', '2ab048bf-7412-4188-8507-fc582909a73e', 'f5bb6fe6-3045-45c0-9143-94b6c10992d7'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:11:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-090dcaf6-fb60-442a-8462-7a4698d59d52 tempest-AttachVolumeShelveTestJSON-1437213778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-090dcaf6-fb60-442a-8462-7a4698d59d52 tempest-AttachVolumeShelveTestJSON-1437213778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-090dcaf6-fb60-442a-8462-7a4698d59d52 tempest-AttachVolumeShelveTestJSON-1437213778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-090dcaf6-fb60-442a-8462-7a4698d59d52 tempest-AttachVolumeShelveTestJSON-1437213778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-090dcaf6-fb60-442a-8462-7a4698d59d52 tempest-AttachVolumeShelveTestJSON-1437213778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-090dcaf6-fb60-442a-8462-7a4698d59d52 tempest-AttachVolumeShelveTestJSON-1437213778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:15 devstack sudo[90391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:11:15 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:15 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-49a99894-dbce-48c0-886e-e04931dfa9f0 tempest-VolumesDeleteCascade-1506885483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9" returned: 0 in 0.424s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-49a99894-dbce-48c0-886e-e04931dfa9f0 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:15 devstack sudo[90396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156 1G
Sep 16 16:11:15 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:15 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-090dcaf6-fb60-442a-8462-7a4698d59d52 tempest-AttachVolumeShelveTestJSON-1437213778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.295s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:15 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-090dcaf6-fb60-442a-8462-7a4698d59d52 tempest-AttachVolumeShelveTestJSON-1437213778 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:11:15 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-090dcaf6-fb60-442a-8462-7a4698d59d52 tempest-AttachVolumeShelveTestJSON-1437213778 None] Deleted volume successfully.
Sep 16 16:11:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-090dcaf6-fb60-442a-8462-7a4698d59d52 tempest-AttachVolumeShelveTestJSON-1437213778 None] Lock "cinder-c8832599-21f4-486b-b397-15c2209a80fa-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:16 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-49a99894-dbce-48c0-886e-e04931dfa9f0 tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156 1G" returned: 0 in 0.573s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-49a99894-dbce-48c0-886e-e04931dfa9f0 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:16 devstack sudo[90403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156
Sep 16 16:11:16 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:16 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-49a99894-dbce-48c0-886e-e04931dfa9f0 tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156" returned: 0 in 0.354s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:16 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-49a99894-dbce-48c0-886e-e04931dfa9f0 tempest-VolumesDeleteCascade-1506885483 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156 is being set with open permissions: ugo+rw
Sep 16 16:11:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-49a99894-dbce-48c0-886e-e04931dfa9f0 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:16 devstack sudo[90408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156
Sep 16 16:11:16 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:16 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-49a99894-dbce-48c0-886e-e04931dfa9f0 tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156" returned: 0 in 0.286s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-49a99894-dbce-48c0-886e-e04931dfa9f0 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:16 devstack sudo[90411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.info
Sep 16 16:11:16 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:17 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-49a99894-dbce-48c0-886e-e04931dfa9f0 tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.info" returned: 0 in 0.338s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:17 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-49a99894-dbce-48c0-886e-e04931dfa9f0 tempest-VolumesDeleteCascade-1506885483 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.info is being set with open permissions: ugo+rw
Sep 16 16:11:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-49a99894-dbce-48c0-886e-e04931dfa9f0 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:17 devstack sudo[90414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.info
Sep 16 16:11:17 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:17 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-49a99894-dbce-48c0-886e-e04931dfa9f0 tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.info" returned: 0 in 0.323s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-49a99894-dbce-48c0-886e-e04931dfa9f0 tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.421s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:17 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-49a99894-dbce-48c0-886e-e04931dfa9f0 tempest-VolumesDeleteCascade-1506885483 None] Create snapshot completed successfully
Sep 16 16:11:18 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Flow 'volume_create_manager' (51b7259a-26d7-4a52-b734-133e6cca8397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f217f66-0872-4cd5-ac47-6a1cafc9bbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f217f66-0872-4cd5-ac47-6a1cafc9bbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1414183778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1a6460-d8ff-4f1e-974c-3885b7168f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7046f9da8f18493eb12edd90a9a5b270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3a216eb8-c878-4289-930d-f944d0c28156,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:19Z,use_quota=True,user_id='2223923c748343e0a0a251b1f116cca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d7f2cc8-c9e7-4112-b878-6fbe4e8ccd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d7f2cc8-c9e7-4112-b878-6fbe4e8ccd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86dde107-3f44-48ea-a6cc-134848807ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86dde107-3f44-48ea-a6cc-134848807ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0b1a6460-d8ff-4f1e-974c-3885b7168f01', 'volume_name': 'volume-0b1a6460-d8ff-4f1e-974c-3885b7168f01', 'volume_size': 1, 'snapshot_id': '3a216eb8-c878-4289-930d-f944d0c28156'}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a876e2c6-21f1-401d-80c3-7545227fbab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a876e2c6-21f1-401d-80c3-7545227fbab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ae1f998-8377-4b36-a32f-decfba47448d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:19 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Volume 0b1a6460-d8ff-4f1e-974c-3885b7168f01: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0b1a6460-d8ff-4f1e-974c-3885b7168f01', 'volume_size': 1, 'snapshot_id': '3a216eb8-c878-4289-930d-f944d0c28156'}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "cinder-quobyte-3a216eb8-c878-4289-930d-f944d0c28156-0b1a6460-d8ff-4f1e-974c-3885b7168f01" by "_create_volume_from_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-quobyte-3a216eb8-c878-4289-930d-f944d0c28156-0b1a6460-d8ff-4f1e-974c-3885b7168f01" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Creating volume 0b1a6460-d8ff-4f1e-974c-3885b7168f01 from snapshot 3a216eb8-c878-4289-930d-f944d0c28156 {{(pid=86165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "cinder-quobyte-0b1a6460-d8ff-4f1e-974c-3885b7168f01" by "_copy_volume_from_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-quobyte-0b1a6460-d8ff-4f1e-974c-3885b7168f01" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] snapshot: 3a216eb8-c878-4289-930d-f944d0c28156, volume: 0b1a6460-d8ff-4f1e-974c-3885b7168f01,  {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[09add683-bad9-4838-a851-8da4e0acf35e]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:19 devstack sudo[90418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156
Sep 16 16:11:19 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:19 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156" returned: 0 in 0.367s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9419569a-1de3-4208-b3c6-27b0472531cb]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:19 devstack sudo[90423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9
Sep 16 16:11:19 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:20 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9" returned: 0 in 0.388s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] will copy from snapshot at /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9 {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 16:11:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Creating direct copy from snapshot {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 16:11:20 devstack cinder-volume[86165]: DEBUG cinder.utils [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Path /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0b1a6460-d8ff-4f1e-974c-3885b7168f01 not found in is_blk_device check {{(pid=86165) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 16:11:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0b1a6460-d8ff-4f1e-974c-3885b7168f01 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:20 devstack sudo[90429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0b1a6460-d8ff-4f1e-974c-3885b7168f01
Sep 16 16:11:20 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-d201fbd8-3638-483c-92f3-e239e61cd65b req-6f7033d4-ac3c-4283-aaf5-fcfbf10af4c1 tempest-ServerActionsTestOtherA-2007622607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:28 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:11:28 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Flow 'volume_create_manager' (da4497f2-74d6-451f-a497-f0a146c6fc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:11:28 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe102c5-882b-484b-bf44-aad20652ee34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:28 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe102c5-882b-484b-bf44-aad20652ee34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1111881110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2781084-fbd6-47ff-8f57-0748d6320da3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c504830a5ae143fe83eb17dcc4ade441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:29Z,use_quota=True,user_id='1e90767507704cc38d5e152101e72725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:28 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9867c38-8dba-4a77-ad61-e79054e7d176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:28 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9867c38-8dba-4a77-ad61-e79054e7d176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:28 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d70d5e-2290-4104-8f45-8e5a73587af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:28 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d70d5e-2290-4104-8f45-8e5a73587af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2781084-fbd6-47ff-8f57-0748d6320da3', 'volume_name': 'volume-f2781084-fbd6-47ff-8f57-0748d6320da3', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:28 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815daf47-7aba-4383-9483-df466f06b4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:28 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815daf47-7aba-4383-9483-df466f06b4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:28 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e38539-fd5f-4096-97c9-f65fd06ec8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:28 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Volume f2781084-fbd6-47ff-8f57-0748d6320da3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2781084-fbd6-47ff-8f57-0748d6320da3', 'volume_size': 1}
Sep 16 16:11:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:28 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0b1a6460-d8ff-4f1e-974c-3885b7168f01" returned: 0 in 8.808s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:28 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Image conversion details: src /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9, size 1024.00 MB, duration 8.81 sec, destination /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0b1a6460-d8ff-4f1e-974c-3885b7168f01 {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:11:28 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Converted 1024.00 MB image at 116.25 MB/s
Sep 16 16:11:28 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0b1a6460-d8ff-4f1e-974c-3885b7168f01 is being set with open permissions: ugo+rw
Sep 16 16:11:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0b1a6460-d8ff-4f1e-974c-3885b7168f01 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:28 devstack sudo[90478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0b1a6460-d8ff-4f1e-974c-3885b7168f01
Sep 16 16:11:28 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:29 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0b1a6460-d8ff-4f1e-974c-3885b7168f01" returned: 0 in 0.244s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-quobyte-0b1a6460-d8ff-4f1e-974c-3885b7168f01" released by "_copy_volume_from_snapshot" :: held 9.906s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-quobyte-3a216eb8-c878-4289-930d-f944d0c28156-0b1a6460-d8ff-4f1e-974c-3885b7168f01" released by "_create_volume_from_snapshot" :: held 9.976s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-d201fbd8-3638-483c-92f3-e239e61cd65b req-6f7033d4-ac3c-4283-aaf5-fcfbf10af4c1 tempest-ServerActionsTestOtherA-2007622607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.572s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-d201fbd8-3638-483c-92f3-e239e61cd65b req-6f7033d4-ac3c-4283-aaf5-fcfbf10af4c1 tempest-ServerActionsTestOtherA-2007622607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.326s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1111881110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2781084-fbd6-47ff-8f57-0748d6320da3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c504830a5ae143fe83eb17dcc4ade441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:29Z,use_quota=True,user_id='1e90767507704cc38d5e152101e72725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Creating volume f2781084-fbd6-47ff-8f57-0748d6320da3 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:11:29 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f2781084-fbd6-47ff-8f57-0748d6320da3 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:29 devstack sudo[90481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f2781084-fbd6-47ff-8f57-0748d6320da3 1073741824
Sep 16 16:11:29 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ae1f998-8377-4b36-a32f-decfba47448d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b1a6460-d8ff-4f1e-974c-3885b7168f01', 'volume_size': 1, 'snapshot_id': '3a216eb8-c878-4289-930d-f944d0c28156'}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7edaa42e-5238-4b69-a475-b527c44ae10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:29 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Volume volume-0b1a6460-d8ff-4f1e-974c-3885b7168f01 (0b1a6460-d8ff-4f1e-974c-3885b7168f01): created successfully
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7edaa42e-5238-4b69-a475-b527c44ae10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Flow 'volume_create_manager' (51b7259a-26d7-4a52-b734-133e6cca8397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-d201fbd8-3638-483c-92f3-e239e61cd65b req-6f7033d4-ac3c-4283-aaf5-fcfbf10af4c1 tempest-ServerActionsTestOtherA-2007622607 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97cbb185-abba-488a-b5e8-73f74f9678c5', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:11:29 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-0f51077b-db24-4f97-ac19-76dfa41f901c tempest-VolumesDeleteCascade-1506885483 None] Created volume successfully.
Sep 16 16:11:29 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-d201fbd8-3638-483c-92f3-e239e61cd65b req-6f7033d4-ac3c-4283-aaf5-fcfbf10af4c1 tempest-ServerActionsTestOtherA-2007622607 None] attachment_update completed successfully.
Sep 16 16:11:29 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f2781084-fbd6-47ff-8f57-0748d6320da3 1073741824" returned: 0 in 0.570s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f2781084-fbd6-47ff-8f57-0748d6320da3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:29 devstack sudo[90900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f2781084-fbd6-47ff-8f57-0748d6320da3
Sep 16 16:11:29 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "cinder-7aac0769-5a1a-4f53-b4b3-32254f649bf9-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-7aac0769-5a1a-4f53-b4b3-32254f649bf9-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Performing cascade delete. {{(pid=86165) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 16 16:11:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "cinder-3a216eb8-c878-4289-930d-f944d0c28156-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-3a216eb8-c878-4289-930d-f944d0c28156-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "cinder-quobyte-7aac0769-5a1a-4f53-b4b3-32254f649bf9" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-quobyte-7aac0769-5a1a-4f53-b4b3-32254f649bf9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "cinder-quobyte-3a216eb8-c878-4289-930d-f944d0c28156" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-quobyte-3a216eb8-c878-4289-930d-f944d0c28156" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:30 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Deleting offline snapshot 3a216eb8-c878-4289-930d-f944d0c28156 of volume 7aac0769-5a1a-4f53-b4b3-32254f649bf9 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:11:30 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] snapshot_file for this snap is: volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:11:30 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:30 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbf8b2f-ba7d-45d5-9ca0-619757b89a0b]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f2781084-fbd6-47ff-8f57-0748d6320da3" returned: 0 in 0.346s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:30 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:11:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e38539-fd5f-4096-97c9-f65fd06ec8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2781084-fbd6-47ff-8f57-0748d6320da3', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05067fc8-b61c-48c1-8678-a78b65457d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:30 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Volume volume-f2781084-fbd6-47ff-8f57-0748d6320da3 (f2781084-fbd6-47ff-8f57-0748d6320da3): created successfully
Sep 16 16:11:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05067fc8-b61c-48c1-8678-a78b65457d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Flow 'volume_create_manager' (da4497f2-74d6-451f-a497-f0a146c6fc2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:11:30 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c178a321-6659-46e2-a46a-60ccacf797f6 tempest-VolumesTestJSON-1774687502 None] Created volume successfully.
Sep 16 16:11:30 devstack sudo[90904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156
Sep 16 16:11:30 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:30 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156" returned: 0 in 0.435s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:30 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:11:30 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1265f41e-fee8-4cec-918d-f13e17fb79f2]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:30 devstack sudo[90909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9
Sep 16 16:11:30 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:31 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9" returned: 0 in 0.627s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:31 devstack sudo[90914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156
Sep 16 16:11:31 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Flow 'volume_create_manager' (2f95c75f-09d6-44b0-80bf-7aabb4c83ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fbac978-814d-4060-90c0-7327470899ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:31 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156" returned: 0 in 0.514s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fbac978-814d-4060-90c0-7327470899ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-887339754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c146e24-772b-446b-94c0-c930eb153a74,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c504830a5ae143fe83eb17dcc4ade441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:32Z,use_quota=True,user_id='1e90767507704cc38d5e152101e72725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:31 devstack sudo[90920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156
Sep 16 16:11:31 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd54adbb-5049-48c8-b53f-5727156284d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd54adbb-5049-48c8-b53f-5727156284d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63112bd-cab1-4e18-ba38-d81f5e627707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63112bd-cab1-4e18-ba38-d81f5e627707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c146e24-772b-446b-94c0-c930eb153a74', 'volume_name': 'volume-8c146e24-772b-446b-94c0-c930eb153a74', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6fec081-0dec-453b-b8cb-1b73a0a7c30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6fec081-0dec-453b-b8cb-1b73a0a7c30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39faacfb-e2b5-4dc8-b0a9-c768ca46a48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:31 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Volume 8c146e24-772b-446b-94c0-c930eb153a74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c146e24-772b-446b-94c0-c930eb153a74', 'volume_size': 1}
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-887339754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c146e24-772b-446b-94c0-c930eb153a74,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c504830a5ae143fe83eb17dcc4ade441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:32Z,use_quota=True,user_id='1e90767507704cc38d5e152101e72725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Creating volume 8c146e24-772b-446b-94c0-c930eb153a74 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:11:31 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:11:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8c146e24-772b-446b-94c0-c930eb153a74 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:31 devstack sudo[90923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8c146e24-772b-446b-94c0-c930eb153a74 1073741824
Sep 16 16:11:31 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:32 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9.3a216eb8-c878-4289-930d-f944d0c28156" returned: 0 in 0.433s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-quobyte-3a216eb8-c878-4289-930d-f944d0c28156" released by "_delete_snapshot" :: held 2.142s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-quobyte-7aac0769-5a1a-4f53-b4b3-32254f649bf9" released by "delete_snapshot" :: held 2.176s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:32 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Created reservations ['7fecc26e-ec54-43c0-a32a-3c3d281928ea', '635943b1-0332-4182-87b9-9cafcead261f', '65452ad0-0440-4bed-b9c9-f0d63faf5984', '644436b8-8d0b-411d-8953-c831fd2ca0bb'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:11:32 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Delete snapshot completed successfully.
Sep 16 16:11:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-3a216eb8-c878-4289-930d-f944d0c28156-delete_snapshot" released by "delete_snapshot" :: held 2.406s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Snapshots deleted, issuing volume delete {{(pid=86165) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 16 16:11:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "cinder-quobyte-7aac0769-5a1a-4f53-b4b3-32254f649bf9" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-quobyte-7aac0769-5a1a-4f53-b4b3-32254f649bf9" acquired by "delete_volume" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:32 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8c146e24-772b-446b-94c0-c930eb153a74 1073741824" returned: 0 in 0.660s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:32 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ecf2b5-9748-42c9-ab6a-0c57d776aeb1]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8c146e24-772b-446b-94c0-c930eb153a74 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:32 devstack sudo[90933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8c146e24-772b-446b-94c0-c930eb153a74
Sep 16 16:11:32 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:32 devstack sudo[90932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9
Sep 16 16:11:32 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:32 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8c146e24-772b-446b-94c0-c930eb153a74" returned: 0 in 0.277s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:11:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39faacfb-e2b5-4dc8-b0a9-c768ca46a48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c146e24-772b-446b-94c0-c930eb153a74', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ddbad9e-4ca6-48c4-aea6-df60415743b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:32 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Volume volume-8c146e24-772b-446b-94c0-c930eb153a74 (8c146e24-772b-446b-94c0-c930eb153a74): created successfully
Sep 16 16:11:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ddbad9e-4ca6-48c4-aea6-df60415743b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Flow 'volume_create_manager' (2f95c75f-09d6-44b0-80bf-7aabb4c83ab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:11:32 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-579ce6ae-79e7-4bcf-a861-66cea03e5c9f tempest-VolumesTestJSON-1774687502 None] Created volume successfully.
Sep 16 16:11:32 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9" returned: 0 in 0.433s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:33 devstack sudo[90945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9
Sep 16 16:11:33 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:33 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-674f3f1b-1b98-42a7-aedc-b6b4d08c58d4 req-0bbfbfab-f1b7-42a3-8365-b4b9f579a46e tempest-ServerActionsTestOtherA-2007622607 None] Terminate volume connection completed successfully.
Sep 16 16:11:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-674f3f1b-1b98-42a7-aedc-b6b4d08c58d4 req-0bbfbfab-f1b7-42a3-8365-b4b9f579a46e tempest-ServerActionsTestOtherA-2007622607 None] Deleting attachment 97cbb185-abba-488a-b5e8-73f74f9678c5. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:11:33 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7aac0769-5a1a-4f53-b4b3-32254f649bf9" returned: 0 in 0.303s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-quobyte-7aac0769-5a1a-4f53-b4b3-32254f649bf9" released by "delete_volume" :: held 0.883s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:33 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Created reservations ['29ecb370-4adc-494c-b30f-d1422b788230', '704d74da-00d2-430e-be4c-2a74f89a156f', '94ca6910-6a07-415c-99bc-6c4d9f6163d5', '16a12488-a72b-4aa2-9e8a-ce1e1fe723d2'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:11:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:33 devstack sudo[90988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:11:33 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:34 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.445s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:11:34 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Deleted volume successfully.
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fc7af8ec-8878-46fa-a740-665363d87602 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-7aac0769-5a1a-4f53-b4b3-32254f649bf9-delete_volume" released by "delete_volume" :: held 4.106s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-674f3f1b-1b98-42a7-aedc-b6b4d08c58d4 req-3e3b561b-f9a5-49fe-8a2a-e0fbf081b8c8 tempest-ServerActionsTestOtherA-2007622607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-674f3f1b-1b98-42a7-aedc-b6b4d08c58d4 req-3e3b561b-f9a5-49fe-8a2a-e0fbf081b8c8 tempest-ServerActionsTestOtherA-2007622607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-674f3f1b-1b98-42a7-aedc-b6b4d08c58d4 req-3e3b561b-f9a5-49fe-8a2a-e0fbf081b8c8 tempest-ServerActionsTestOtherA-2007622607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-674f3f1b-1b98-42a7-aedc-b6b4d08c58d4 req-3e3b561b-f9a5-49fe-8a2a-e0fbf081b8c8 tempest-ServerActionsTestOtherA-2007622607 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a03f6d4-cdd9-4ace-be53-ab6af0c01d61', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:11:34 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-674f3f1b-1b98-42a7-aedc-b6b4d08c58d4 req-3e3b561b-f9a5-49fe-8a2a-e0fbf081b8c8 tempest-ServerActionsTestOtherA-2007622607 None] attachment_update completed successfully.
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Flow 'volume_create_manager' (42c5489f-324a-43c5-b515-e38c839e260d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec318bb8-0765-49dd-9080-67eeb5a3a289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec318bb8-0765-49dd-9080-67eeb5a3a289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2069316868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132abbfa-4ee4-429a-858e-735328222c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca81ea2aee742b3b259b5cdb524c966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:34Z,use_quota=True,user_id='181ca72eeb754bdb91e86984bd12cec6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b20e0ec-6a79-4161-a42a-031b02a0924e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b20e0ec-6a79-4161-a42a-031b02a0924e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e1b494-38e1-47c1-a44c-235a77c8bafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e1b494-38e1-47c1-a44c-235a77c8bafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '132abbfa-4ee4-429a-858e-735328222c09', 'volume_name': 'volume-132abbfa-4ee4-429a-858e-735328222c09', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0069fb1-455f-4003-9978-b7aff0f0e922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0069fb1-455f-4003-9978-b7aff0f0e922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e85003-d7e8-48dd-9018-21ba94e9291b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:34 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Volume 132abbfa-4ee4-429a-858e-735328222c09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-132abbfa-4ee4-429a-858e-735328222c09', 'volume_size': 1}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2069316868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132abbfa-4ee4-429a-858e-735328222c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca81ea2aee742b3b259b5cdb524c966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:34Z,use_quota=True,user_id='181ca72eeb754bdb91e86984bd12cec6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Creating volume 132abbfa-4ee4-429a-858e-735328222c09 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:11:34 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-132abbfa-4ee4-429a-858e-735328222c09 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:34 devstack sudo[91007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-132abbfa-4ee4-429a-858e-735328222c09 1073741824
Sep 16 16:11:34 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6904b104-ea42-481d-83c7-61a103b086d8 tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "cinder-0b1a6460-d8ff-4f1e-974c-3885b7168f01-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Flow 'volume_create_manager' (3749a286-2760-40cb-ae0b-996ffb56044e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98defb5c-b8be-4481-8306-60f35588daca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6904b104-ea42-481d-83c7-61a103b086d8 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-0b1a6460-d8ff-4f1e-974c-3885b7168f01-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98defb5c-b8be-4481-8306-60f35588daca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-717434525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c13267-4d2c-4420-b297-7cc80ab208ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c504830a5ae143fe83eb17dcc4ade441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:35Z,use_quota=True,user_id='1e90767507704cc38d5e152101e72725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0081345a-f011-46b5-871c-3196050d9005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0081345a-f011-46b5-871c-3196050d9005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b10a81-b14a-4445-8c17-a22e57e240b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b10a81-b14a-4445-8c17-a22e57e240b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7c13267-4d2c-4420-b297-7cc80ab208ed', 'volume_name': 'volume-a7c13267-4d2c-4420-b297-7cc80ab208ed', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d475419b-9459-48b2-a071-27549d6a6728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d475419b-9459-48b2-a071-27549d6a6728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0091bb03-1856-4f3b-bfbd-c41509b76e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:34 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Volume a7c13267-4d2c-4420-b297-7cc80ab208ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7c13267-4d2c-4420-b297-7cc80ab208ed', 'volume_size': 1}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6904b104-ea42-481d-83c7-61a103b086d8 tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "cinder-quobyte-0b1a6460-d8ff-4f1e-974c-3885b7168f01" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6904b104-ea42-481d-83c7-61a103b086d8 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-quobyte-0b1a6460-d8ff-4f1e-974c-3885b7168f01" acquired by "delete_volume" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d10838a-8837-4129-a4a2-15b3d43d4e46]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6904b104-ea42-481d-83c7-61a103b086d8 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0b1a6460-d8ff-4f1e-974c-3885b7168f01 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:35 devstack sudo[91013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0b1a6460-d8ff-4f1e-974c-3885b7168f01
Sep 16 16:11:35 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:35 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-132abbfa-4ee4-429a-858e-735328222c09 1073741824" returned: 0 in 0.596s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-132abbfa-4ee4-429a-858e-735328222c09 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:35 devstack sudo[91030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-132abbfa-4ee4-429a-858e-735328222c09
Sep 16 16:11:35 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:35 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6904b104-ea42-481d-83c7-61a103b086d8 tempest-VolumesDeleteCascade-1506885483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0b1a6460-d8ff-4f1e-974c-3885b7168f01" returned: 0 in 0.404s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6904b104-ea42-481d-83c7-61a103b086d8 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0b1a6460-d8ff-4f1e-974c-3885b7168f01 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:35 devstack sudo[91034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0b1a6460-d8ff-4f1e-974c-3885b7168f01
Sep 16 16:11:35 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:35 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-132abbfa-4ee4-429a-858e-735328222c09" returned: 0 in 0.275s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.678s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-717434525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c13267-4d2c-4420-b297-7cc80ab208ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c504830a5ae143fe83eb17dcc4ade441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:35Z,use_quota=True,user_id='1e90767507704cc38d5e152101e72725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Creating volume a7c13267-4d2c-4420-b297-7cc80ab208ed {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:11:35 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a7c13267-4d2c-4420-b297-7cc80ab208ed 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e85003-d7e8-48dd-9018-21ba94e9291b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-132abbfa-4ee4-429a-858e-735328222c09', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:35 devstack sudo[91063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a7c13267-4d2c-4420-b297-7cc80ab208ed 1073741824
Sep 16 16:11:35 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808eb7c0-b4f7-4a1b-a211-b5d2544c3d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:35 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Volume volume-132abbfa-4ee4-429a-858e-735328222c09 (132abbfa-4ee4-429a-858e-735328222c09): created successfully
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808eb7c0-b4f7-4a1b-a211-b5d2544c3d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Flow 'volume_create_manager' (42c5489f-324a-43c5-b515-e38c839e260d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:11:35 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6904b104-ea42-481d-83c7-61a103b086d8 tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0b1a6460-d8ff-4f1e-974c-3885b7168f01" returned: 0 in 0.309s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:35 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-20c0c705-aec7-4a26-a979-5bc7a47c1a28 tempest-VolumeQuotasAdminTestJSON-22401060 None] Created volume successfully.
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6904b104-ea42-481d-83c7-61a103b086d8 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-quobyte-0b1a6460-d8ff-4f1e-974c-3885b7168f01" released by "delete_volume" :: held 0.771s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-6904b104-ea42-481d-83c7-61a103b086d8 tempest-VolumesDeleteCascade-1506885483 None] Created reservations ['04242b03-5cc8-4b10-ac2e-4ff34673d390', '42cdc916-bb0f-4af9-b1e7-1f0e0fc31dc5', '4fc5f9d6-bbdb-4766-aba3-5aa58ed43388', '10445aad-c6f4-474a-8ce4-cfec89bad925'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6904b104-ea42-481d-83c7-61a103b086d8 tempest-VolumesDeleteCascade-1506885483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6904b104-ea42-481d-83c7-61a103b086d8 tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6904b104-ea42-481d-83c7-61a103b086d8 tempest-VolumesDeleteCascade-1506885483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6904b104-ea42-481d-83c7-61a103b086d8 tempest-VolumesDeleteCascade-1506885483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6904b104-ea42-481d-83c7-61a103b086d8 tempest-VolumesDeleteCascade-1506885483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6904b104-ea42-481d-83c7-61a103b086d8 tempest-VolumesDeleteCascade-1506885483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:35 devstack sudo[91150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:11:35 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:36 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a7c13267-4d2c-4420-b297-7cc80ab208ed 1073741824" returned: 0 in 0.831s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:36 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6904b104-ea42-481d-83c7-61a103b086d8 tempest-VolumesDeleteCascade-1506885483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.484s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:36 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-6904b104-ea42-481d-83c7-61a103b086d8 tempest-VolumesDeleteCascade-1506885483 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:11:36 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-6904b104-ea42-481d-83c7-61a103b086d8 tempest-VolumesDeleteCascade-1506885483 None] Deleted volume successfully.
Sep 16 16:11:36 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6904b104-ea42-481d-83c7-61a103b086d8 tempest-VolumesDeleteCascade-1506885483 None] Lock "cinder-0b1a6460-d8ff-4f1e-974c-3885b7168f01-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a7c13267-4d2c-4420-b297-7cc80ab208ed {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:36 devstack sudo[91487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a7c13267-4d2c-4420-b297-7cc80ab208ed
Sep 16 16:11:36 devstack sudo[91487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:36 devstack sudo[91487]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a7c13267-4d2c-4420-b297-7cc80ab208ed" returned: 0 in 0.317s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:11:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0091bb03-1856-4f3b-bfbd-c41509b76e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7c13267-4d2c-4420-b297-7cc80ab208ed', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f7c883-24aa-42e9-9c44-ee3d6467e091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:36 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Volume volume-a7c13267-4d2c-4420-b297-7cc80ab208ed (a7c13267-4d2c-4420-b297-7cc80ab208ed): created successfully
Sep 16 16:11:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f7c883-24aa-42e9-9c44-ee3d6467e091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Flow 'volume_create_manager' (3749a286-2760-40cb-ae0b-996ffb56044e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:11:36 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-362cefe8-74ff-4031-88dd-a02845920603 tempest-VolumeQuotasAdminTestJSON-22401060 None] Acquiring lock "cinder-132abbfa-4ee4-429a-858e-735328222c09-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:36 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-99b55907-984b-455d-9402-1b26d89913f0 tempest-VolumesTestJSON-1774687502 None] Created volume successfully.
Sep 16 16:11:36 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-362cefe8-74ff-4031-88dd-a02845920603 tempest-VolumeQuotasAdminTestJSON-22401060 None] Lock "cinder-132abbfa-4ee4-429a-858e-735328222c09-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:36 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-362cefe8-74ff-4031-88dd-a02845920603 tempest-VolumeQuotasAdminTestJSON-22401060 None] Acquiring lock "cinder-quobyte-132abbfa-4ee4-429a-858e-735328222c09" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:36 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-362cefe8-74ff-4031-88dd-a02845920603 tempest-VolumeQuotasAdminTestJSON-22401060 None] Lock "cinder-quobyte-132abbfa-4ee4-429a-858e-735328222c09" acquired by "delete_volume" :: waited 0.021s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:37 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a753d2b3-ad1c-4ded-9c2d-dc76be93a757]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-362cefe8-74ff-4031-88dd-a02845920603 tempest-VolumeQuotasAdminTestJSON-22401060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-132abbfa-4ee4-429a-858e-735328222c09 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:37 devstack sudo[91501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-132abbfa-4ee4-429a-858e-735328222c09
Sep 16 16:11:37 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:37 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-362cefe8-74ff-4031-88dd-a02845920603 tempest-VolumeQuotasAdminTestJSON-22401060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-132abbfa-4ee4-429a-858e-735328222c09" returned: 0 in 0.455s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-362cefe8-74ff-4031-88dd-a02845920603 tempest-VolumeQuotasAdminTestJSON-22401060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-132abbfa-4ee4-429a-858e-735328222c09 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:37 devstack sudo[91506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-132abbfa-4ee4-429a-858e-735328222c09
Sep 16 16:11:37 devstack sudo[91506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:37 devstack sudo[91506]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-362cefe8-74ff-4031-88dd-a02845920603 tempest-VolumeQuotasAdminTestJSON-22401060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-132abbfa-4ee4-429a-858e-735328222c09" returned: 0 in 0.370s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-362cefe8-74ff-4031-88dd-a02845920603 tempest-VolumeQuotasAdminTestJSON-22401060 None] Lock "cinder-quobyte-132abbfa-4ee4-429a-858e-735328222c09" released by "delete_volume" :: held 0.939s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:38 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-362cefe8-74ff-4031-88dd-a02845920603 tempest-VolumeQuotasAdminTestJSON-22401060 None] Created reservations ['6f73c6ec-350f-4c0e-8da5-30e04b69e039', '58563c61-4132-4199-b986-3efff7f6b0c2', '617e0258-2997-468b-a040-580b9316504a', '7a2706b2-6d16-4d00-baed-4139db7d6458'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:11:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-362cefe8-74ff-4031-88dd-a02845920603 tempest-VolumeQuotasAdminTestJSON-22401060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-362cefe8-74ff-4031-88dd-a02845920603 tempest-VolumeQuotasAdminTestJSON-22401060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:38 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-362cefe8-74ff-4031-88dd-a02845920603 tempest-VolumeQuotasAdminTestJSON-22401060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:38 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-362cefe8-74ff-4031-88dd-a02845920603 tempest-VolumeQuotasAdminTestJSON-22401060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-362cefe8-74ff-4031-88dd-a02845920603 tempest-VolumeQuotasAdminTestJSON-22401060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-362cefe8-74ff-4031-88dd-a02845920603 tempest-VolumeQuotasAdminTestJSON-22401060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:38 devstack sudo[91512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:11:38 devstack sudo[91512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:38 devstack sudo[91512]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-362cefe8-74ff-4031-88dd-a02845920603 tempest-VolumeQuotasAdminTestJSON-22401060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.470s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:38 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-362cefe8-74ff-4031-88dd-a02845920603 tempest-VolumeQuotasAdminTestJSON-22401060 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:11:38 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-362cefe8-74ff-4031-88dd-a02845920603 tempest-VolumeQuotasAdminTestJSON-22401060 None] Deleted volume successfully.
Sep 16 16:11:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-362cefe8-74ff-4031-88dd-a02845920603 tempest-VolumeQuotasAdminTestJSON-22401060 None] Lock "cinder-132abbfa-4ee4-429a-858e-735328222c09-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-67e75162-3462-4ac0-a34a-d6557ffddc53 tempest-VolumesTestJSON-1774687502 None] Acquiring lock "cinder-a7c13267-4d2c-4420-b297-7cc80ab208ed-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-67e75162-3462-4ac0-a34a-d6557ffddc53 tempest-VolumesTestJSON-1774687502 None] Lock "cinder-a7c13267-4d2c-4420-b297-7cc80ab208ed-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:39 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=106,cinder:UPDATE=127,cinder:DELETE=12,cinder:INSERT=30 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:11:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-67e75162-3462-4ac0-a34a-d6557ffddc53 tempest-VolumesTestJSON-1774687502 None] Acquiring lock "cinder-quobyte-a7c13267-4d2c-4420-b297-7cc80ab208ed" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-67e75162-3462-4ac0-a34a-d6557ffddc53 tempest-VolumesTestJSON-1774687502 None] Lock "cinder-quobyte-a7c13267-4d2c-4420-b297-7cc80ab208ed" acquired by "delete_volume" :: waited 0.032s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:39 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[241c3746-a468-49bc-a3e6-c397eace33fe]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-67e75162-3462-4ac0-a34a-d6557ffddc53 tempest-VolumesTestJSON-1774687502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a7c13267-4d2c-4420-b297-7cc80ab208ed {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:40 devstack sudo[91520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a7c13267-4d2c-4420-b297-7cc80ab208ed
Sep 16 16:11:40 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=103,cinder:UPDATE=117,cinder:INSERT=27,cinder:DELETE=10 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Flow 'volume_create_manager' (d6498b69-3506-411c-9a5c-1646942fd417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63c8a7a-48d0-4b5f-b3bb-beb1652fb8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63c8a7a-48d0-4b5f-b3bb-beb1652fb8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1435765108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca81ea2aee742b3b259b5cdb524c966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:40Z,use_quota=True,user_id='181ca72eeb754bdb91e86984bd12cec6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a60f412-2644-49fa-8724-0d657e70431f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a60f412-2644-49fa-8724-0d657e70431f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d4e833-f915-4dff-984b-c9f49e1e19a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d4e833-f915-4dff-984b-c9f49e1e19a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed', 'volume_name': 'volume-ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749a5e32-47a9-41cf-acd1-594fb94b6723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749a5e32-47a9-41cf-acd1-594fb94b6723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3463ac-3712-4264-9a7c-009ca8a17a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:40 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Volume ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed', 'volume_size': 1}
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1435765108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca81ea2aee742b3b259b5cdb524c966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:40Z,use_quota=True,user_id='181ca72eeb754bdb91e86984bd12cec6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Creating volume ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:11:40 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:40 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-67e75162-3462-4ac0-a34a-d6557ffddc53 tempest-VolumesTestJSON-1774687502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a7c13267-4d2c-4420-b297-7cc80ab208ed" returned: 0 in 0.673s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-67e75162-3462-4ac0-a34a-d6557ffddc53 tempest-VolumesTestJSON-1774687502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a7c13267-4d2c-4420-b297-7cc80ab208ed {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:40 devstack sudo[91538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed 1073741824
Sep 16 16:11:40 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:40 devstack sudo[91540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a7c13267-4d2c-4420-b297-7cc80ab208ed
Sep 16 16:11:40 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:41 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-67e75162-3462-4ac0-a34a-d6557ffddc53 tempest-VolumesTestJSON-1774687502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a7c13267-4d2c-4420-b297-7cc80ab208ed" returned: 0 in 0.430s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-67e75162-3462-4ac0-a34a-d6557ffddc53 tempest-VolumesTestJSON-1774687502 None] Lock "cinder-quobyte-a7c13267-4d2c-4420-b297-7cc80ab208ed" released by "delete_volume" :: held 1.211s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:41 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-67e75162-3462-4ac0-a34a-d6557ffddc53 tempest-VolumesTestJSON-1774687502 None] Created reservations ['c15f159d-f45b-4ae4-b36a-00607a6afe66', 'fd7a5221-e922-49c3-9d8c-f2688120d912', '5b9d2cca-7311-4df8-b05f-284aef66706a', '0f6e4abc-06ca-4200-bbc3-bbbcbf5fc1c2'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:11:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-67e75162-3462-4ac0-a34a-d6557ffddc53 tempest-VolumesTestJSON-1774687502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-67e75162-3462-4ac0-a34a-d6557ffddc53 tempest-VolumesTestJSON-1774687502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:41 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-67e75162-3462-4ac0-a34a-d6557ffddc53 tempest-VolumesTestJSON-1774687502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:41 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-67e75162-3462-4ac0-a34a-d6557ffddc53 tempest-VolumesTestJSON-1774687502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-67e75162-3462-4ac0-a34a-d6557ffddc53 tempest-VolumesTestJSON-1774687502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-67e75162-3462-4ac0-a34a-d6557ffddc53 tempest-VolumesTestJSON-1774687502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:41 devstack sudo[91550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:11:41 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:41 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed 1073741824" returned: 0 in 0.823s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:41 devstack sudo[91552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed
Sep 16 16:11:41 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:41 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-67e75162-3462-4ac0-a34a-d6557ffddc53 tempest-VolumesTestJSON-1774687502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.311s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:41 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-67e75162-3462-4ac0-a34a-d6557ffddc53 tempest-VolumesTestJSON-1774687502 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:11:41 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-67e75162-3462-4ac0-a34a-d6557ffddc53 tempest-VolumesTestJSON-1774687502 None] Deleted volume successfully.
Sep 16 16:11:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-67e75162-3462-4ac0-a34a-d6557ffddc53 tempest-VolumesTestJSON-1774687502 None] Lock "cinder-a7c13267-4d2c-4420-b297-7cc80ab208ed-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:41 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed" returned: 0 in 0.333s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:41 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:11:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3463ac-3712-4264-9a7c-009ca8a17a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e864e0-28b2-4ae6-b0a0-a337d2b966c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:41 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Volume volume-ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed (ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed): created successfully
Sep 16 16:11:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e864e0-28b2-4ae6-b0a0-a337d2b966c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Flow 'volume_create_manager' (d6498b69-3506-411c-9a5c-1646942fd417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:11:41 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c0b31fad-1733-4374-a26a-56a1a2b98002 tempest-VolumeQuotasAdminTestJSON-22401060 None] Created volume successfully.
Sep 16 16:11:42 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5ec0b8bc-76a3-42f3-a390-e5b7f486cd98 tempest-VolumesTestJSON-1774687502 None] Acquiring lock "cinder-8c146e24-772b-446b-94c0-c930eb153a74-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:42 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5ec0b8bc-76a3-42f3-a390-e5b7f486cd98 tempest-VolumesTestJSON-1774687502 None] Lock "cinder-8c146e24-772b-446b-94c0-c930eb153a74-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:42 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5ec0b8bc-76a3-42f3-a390-e5b7f486cd98 tempest-VolumesTestJSON-1774687502 None] Acquiring lock "cinder-quobyte-8c146e24-772b-446b-94c0-c930eb153a74" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:42 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5ec0b8bc-76a3-42f3-a390-e5b7f486cd98 tempest-VolumesTestJSON-1774687502 None] Lock "cinder-quobyte-8c146e24-772b-446b-94c0-c930eb153a74" acquired by "delete_volume" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:42 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d93bd5-b1a3-45e5-bc26-4aaf32e437ee]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5ec0b8bc-76a3-42f3-a390-e5b7f486cd98 tempest-VolumesTestJSON-1774687502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8c146e24-772b-446b-94c0-c930eb153a74 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:42 devstack sudo[91556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8c146e24-772b-446b-94c0-c930eb153a74
Sep 16 16:11:42 devstack sudo[91556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:42 devstack sudo[91556]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5ec0b8bc-76a3-42f3-a390-e5b7f486cd98 tempest-VolumesTestJSON-1774687502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8c146e24-772b-446b-94c0-c930eb153a74" returned: 0 in 0.473s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5ec0b8bc-76a3-42f3-a390-e5b7f486cd98 tempest-VolumesTestJSON-1774687502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8c146e24-772b-446b-94c0-c930eb153a74 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:42 devstack sudo[91562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8c146e24-772b-446b-94c0-c930eb153a74
Sep 16 16:11:42 devstack sudo[91562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:42 devstack sudo[91562]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5ec0b8bc-76a3-42f3-a390-e5b7f486cd98 tempest-VolumesTestJSON-1774687502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8c146e24-772b-446b-94c0-c930eb153a74" returned: 0 in 0.291s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5ec0b8bc-76a3-42f3-a390-e5b7f486cd98 tempest-VolumesTestJSON-1774687502 None] Lock "cinder-quobyte-8c146e24-772b-446b-94c0-c930eb153a74" released by "delete_volume" :: held 0.835s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:43 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-5ec0b8bc-76a3-42f3-a390-e5b7f486cd98 tempest-VolumesTestJSON-1774687502 None] Created reservations ['44aab569-7fbd-4db3-b1d0-97eaf4065c99', '57e6b05a-3beb-416a-bcc4-eb480f42da9e', '8163a2ef-0504-4261-a5cf-bfba569c9e5b', '8fc9779d-89b9-4e34-a782-81d96ceefdf8'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:11:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5ec0b8bc-76a3-42f3-a390-e5b7f486cd98 tempest-VolumesTestJSON-1774687502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5ec0b8bc-76a3-42f3-a390-e5b7f486cd98 tempest-VolumesTestJSON-1774687502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5ec0b8bc-76a3-42f3-a390-e5b7f486cd98 tempest-VolumesTestJSON-1774687502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5ec0b8bc-76a3-42f3-a390-e5b7f486cd98 tempest-VolumesTestJSON-1774687502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5ec0b8bc-76a3-42f3-a390-e5b7f486cd98 tempest-VolumesTestJSON-1774687502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5ec0b8bc-76a3-42f3-a390-e5b7f486cd98 tempest-VolumesTestJSON-1774687502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:43 devstack sudo[91565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:11:43 devstack sudo[91565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:43 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-4ea0a3c9-bf9e-4891-ba88-3d652d0b0ee1 tempest-VolumeQuotasAdminTestJSON-1557589161 None] Transfer volume completed successfully.
Sep 16 16:11:43 devstack sudo[91565]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5ec0b8bc-76a3-42f3-a390-e5b7f486cd98 tempest-VolumesTestJSON-1774687502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.295s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:43 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-5ec0b8bc-76a3-42f3-a390-e5b7f486cd98 tempest-VolumesTestJSON-1774687502 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:11:43 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-5ec0b8bc-76a3-42f3-a390-e5b7f486cd98 tempest-VolumesTestJSON-1774687502 None] Deleted volume successfully.
Sep 16 16:11:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5ec0b8bc-76a3-42f3-a390-e5b7f486cd98 tempest-VolumesTestJSON-1774687502 None] Lock "cinder-8c146e24-772b-446b-94c0-c930eb153a74-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a68164d4-6cd8-4558-a3c5-9c9c6b2f3d36 tempest-VolumesTestJSON-1774687502 None] Acquiring lock "cinder-f2781084-fbd6-47ff-8f57-0748d6320da3-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a68164d4-6cd8-4558-a3c5-9c9c6b2f3d36 tempest-VolumesTestJSON-1774687502 None] Lock "cinder-f2781084-fbd6-47ff-8f57-0748d6320da3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a68164d4-6cd8-4558-a3c5-9c9c6b2f3d36 tempest-VolumesTestJSON-1774687502 None] Acquiring lock "cinder-quobyte-f2781084-fbd6-47ff-8f57-0748d6320da3" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a68164d4-6cd8-4558-a3c5-9c9c6b2f3d36 tempest-VolumesTestJSON-1774687502 None] Lock "cinder-quobyte-f2781084-fbd6-47ff-8f57-0748d6320da3" acquired by "delete_volume" :: waited 0.024s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:43 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c6d931-2e79-4f17-9273-2b28713a0c27]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a68164d4-6cd8-4558-a3c5-9c9c6b2f3d36 tempest-VolumesTestJSON-1774687502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f2781084-fbd6-47ff-8f57-0748d6320da3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:43 devstack sudo[91568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f2781084-fbd6-47ff-8f57-0748d6320da3
Sep 16 16:11:43 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d70463ad-1ffc-4e6c-b268-97d7e9b09f24 tempest-VolumeQuotasAdminTestJSON-1465409575 None] Acquiring lock "cinder-ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d70463ad-1ffc-4e6c-b268-97d7e9b09f24 tempest-VolumeQuotasAdminTestJSON-1465409575 None] Lock "cinder-ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d70463ad-1ffc-4e6c-b268-97d7e9b09f24 tempest-VolumeQuotasAdminTestJSON-1465409575 None] Acquiring lock "cinder-quobyte-ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d70463ad-1ffc-4e6c-b268-97d7e9b09f24 tempest-VolumeQuotasAdminTestJSON-1465409575 None] Lock "cinder-quobyte-ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed" acquired by "delete_volume" :: waited 0.038s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae4a640-1bcb-4068-971a-afd91df8fcba]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d70463ad-1ffc-4e6c-b268-97d7e9b09f24 tempest-VolumeQuotasAdminTestJSON-1465409575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:11:44 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Flow 'volume_create_manager' (afd74507-2447-44ee-8ceb-0cf254bbae9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cbbe411-46d6-4500-af35-c0708538bf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a68164d4-6cd8-4558-a3c5-9c9c6b2f3d36 tempest-VolumesTestJSON-1774687502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f2781084-fbd6-47ff-8f57-0748d6320da3" returned: 0 in 0.526s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a68164d4-6cd8-4558-a3c5-9c9c6b2f3d36 tempest-VolumesTestJSON-1774687502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f2781084-fbd6-47ff-8f57-0748d6320da3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cbbe411-46d6-4500-af35-c0708538bf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2028157841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87db33ed-2d62-4904-b408-de7f7ecd8726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edafe0cb63e546b78670a7345e8008ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:44Z,use_quota=True,user_id='84f08c87d61f4f5f9aa7268c2b6f5473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:44 devstack sudo[91575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f2781084-fbd6-47ff-8f57-0748d6320da3
Sep 16 16:11:44 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe801231-0da0-4b12-a72c-59e167cd810b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe801231-0da0-4b12-a72c-59e167cd810b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a9680f-b343-4033-91eb-b91d65bd4005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a9680f-b343-4033-91eb-b91d65bd4005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87db33ed-2d62-4904-b408-de7f7ecd8726', 'volume_name': 'volume-87db33ed-2d62-4904-b408-de7f7ecd8726', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56918a9-f311-4d23-bd7d-587dcb8a4685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:44 devstack sudo[91573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56918a9-f311-4d23-bd7d-587dcb8a4685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:44 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e036e836-13db-4914-a956-8036ad14e328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:44 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Volume 87db33ed-2d62-4904-b408-de7f7ecd8726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87db33ed-2d62-4904-b408-de7f7ecd8726', 'volume_size': 1}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2028157841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87db33ed-2d62-4904-b408-de7f7ecd8726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edafe0cb63e546b78670a7345e8008ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:44Z,use_quota=True,user_id='84f08c87d61f4f5f9aa7268c2b6f5473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Creating volume 87db33ed-2d62-4904-b408-de7f7ecd8726 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:11:44 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87db33ed-2d62-4904-b408-de7f7ecd8726 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:44 devstack sudo[91578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87db33ed-2d62-4904-b408-de7f7ecd8726 1073741824
Sep 16 16:11:44 devstack sudo[91578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:44 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a68164d4-6cd8-4558-a3c5-9c9c6b2f3d36 tempest-VolumesTestJSON-1774687502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f2781084-fbd6-47ff-8f57-0748d6320da3" returned: 0 in 0.318s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a68164d4-6cd8-4558-a3c5-9c9c6b2f3d36 tempest-VolumesTestJSON-1774687502 None] Lock "cinder-quobyte-f2781084-fbd6-47ff-8f57-0748d6320da3" released by "delete_volume" :: held 0.916s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:44 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d70463ad-1ffc-4e6c-b268-97d7e9b09f24 tempest-VolumeQuotasAdminTestJSON-1465409575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed" returned: 0 in 0.503s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d70463ad-1ffc-4e6c-b268-97d7e9b09f24 tempest-VolumeQuotasAdminTestJSON-1465409575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:44 devstack sudo[91587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed
Sep 16 16:11:44 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-a68164d4-6cd8-4558-a3c5-9c9c6b2f3d36 tempest-VolumesTestJSON-1774687502 None] Created reservations ['71742133-798e-48c6-8d36-3147555ae864', 'eeb7d3bc-d756-42ff-9fe1-303fe672dbc8', 'c0d8d8ba-61ef-49d9-bcec-b441b4da74cf', '3a567fc0-8763-487f-aefd-3d312dc189b6'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a68164d4-6cd8-4558-a3c5-9c9c6b2f3d36 tempest-VolumesTestJSON-1774687502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a68164d4-6cd8-4558-a3c5-9c9c6b2f3d36 tempest-VolumesTestJSON-1774687502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-a68164d4-6cd8-4558-a3c5-9c9c6b2f3d36 tempest-VolumesTestJSON-1774687502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-a68164d4-6cd8-4558-a3c5-9c9c6b2f3d36 tempest-VolumesTestJSON-1774687502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a68164d4-6cd8-4558-a3c5-9c9c6b2f3d36 tempest-VolumesTestJSON-1774687502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a68164d4-6cd8-4558-a3c5-9c9c6b2f3d36 tempest-VolumesTestJSON-1774687502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:44 devstack sudo[91590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:11:44 devstack sudo[91590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:45 devstack sudo[91578]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87db33ed-2d62-4904-b408-de7f7ecd8726 1073741824" returned: 0 in 0.591s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87db33ed-2d62-4904-b408-de7f7ecd8726 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:45 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d70463ad-1ffc-4e6c-b268-97d7e9b09f24 tempest-VolumeQuotasAdminTestJSON-1465409575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed" returned: 0 in 0.411s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:45 devstack sudo[91593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87db33ed-2d62-4904-b408-de7f7ecd8726
Sep 16 16:11:45 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d70463ad-1ffc-4e6c-b268-97d7e9b09f24 tempest-VolumeQuotasAdminTestJSON-1465409575 None] Lock "cinder-quobyte-ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed" released by "delete_volume" :: held 0.991s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-d70463ad-1ffc-4e6c-b268-97d7e9b09f24 tempest-VolumeQuotasAdminTestJSON-1465409575 None] Created reservations ['c65ebbd6-5e0f-4888-8f58-b7d894e9e363', '07099a5f-2fac-4cff-9644-df1c6ac01755', '7594eb24-de13-46bc-93aa-e12cb8e63d18', '2d5776b0-3098-47d1-ae74-68aeecb646d9'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:11:45 devstack sudo[91590]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a68164d4-6cd8-4558-a3c5-9c9c6b2f3d36 tempest-VolumesTestJSON-1774687502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.438s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-a68164d4-6cd8-4558-a3c5-9c9c6b2f3d36 tempest-VolumesTestJSON-1774687502 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:11:45 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-a68164d4-6cd8-4558-a3c5-9c9c6b2f3d36 tempest-VolumesTestJSON-1774687502 None] Deleted volume successfully.
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d70463ad-1ffc-4e6c-b268-97d7e9b09f24 tempest-VolumeQuotasAdminTestJSON-1465409575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d70463ad-1ffc-4e6c-b268-97d7e9b09f24 tempest-VolumeQuotasAdminTestJSON-1465409575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d70463ad-1ffc-4e6c-b268-97d7e9b09f24 tempest-VolumeQuotasAdminTestJSON-1465409575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d70463ad-1ffc-4e6c-b268-97d7e9b09f24 tempest-VolumeQuotasAdminTestJSON-1465409575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d70463ad-1ffc-4e6c-b268-97d7e9b09f24 tempest-VolumeQuotasAdminTestJSON-1465409575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d70463ad-1ffc-4e6c-b268-97d7e9b09f24 tempest-VolumeQuotasAdminTestJSON-1465409575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a68164d4-6cd8-4558-a3c5-9c9c6b2f3d36 tempest-VolumesTestJSON-1774687502 None] Lock "cinder-f2781084-fbd6-47ff-8f57-0748d6320da3-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:45 devstack sudo[91597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:11:45 devstack sudo[91597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:45 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87db33ed-2d62-4904-b408-de7f7ecd8726" returned: 0 in 0.387s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e036e836-13db-4914-a956-8036ad14e328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87db33ed-2d62-4904-b408-de7f7ecd8726', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767de8aa-c044-4757-af11-bdd3b532d6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:45 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Volume volume-87db33ed-2d62-4904-b408-de7f7ecd8726 (87db33ed-2d62-4904-b408-de7f7ecd8726): created successfully
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767de8aa-c044-4757-af11-bdd3b532d6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Flow 'volume_create_manager' (afd74507-2447-44ee-8ceb-0cf254bbae9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:11:45 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-0c85ca21-4545-4200-a5d6-e23ac4d15667 tempest-VolumesTransfersTest-1256361367 None] Created volume successfully.
Sep 16 16:11:45 devstack sudo[91597]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d70463ad-1ffc-4e6c-b268-97d7e9b09f24 tempest-VolumeQuotasAdminTestJSON-1465409575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.289s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-d70463ad-1ffc-4e6c-b268-97d7e9b09f24 tempest-VolumeQuotasAdminTestJSON-1465409575 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:11:45 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-d70463ad-1ffc-4e6c-b268-97d7e9b09f24 tempest-VolumeQuotasAdminTestJSON-1465409575 None] Deleted volume successfully.
Sep 16 16:11:45 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d70463ad-1ffc-4e6c-b268-97d7e9b09f24 tempest-VolumeQuotasAdminTestJSON-1465409575 None] Lock "cinder-ce7d9c2d-6f90-472b-8d2f-a4ad0525dfed-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:47 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-87eb5fb1-0934-42d4-bceb-e4592231e264 tempest-VolumesTransfersTest-457376451 None] Transfer volume completed successfully.
Sep 16 16:11:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-903bb3b2-f866-411a-b1f8-fde242cd998a tempest-VolumesTransfersTest-616191229 None] Acquiring lock "cinder-87db33ed-2d62-4904-b408-de7f7ecd8726-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-903bb3b2-f866-411a-b1f8-fde242cd998a tempest-VolumesTransfersTest-616191229 None] Lock "cinder-87db33ed-2d62-4904-b408-de7f7ecd8726-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-903bb3b2-f866-411a-b1f8-fde242cd998a tempest-VolumesTransfersTest-616191229 None] Acquiring lock "cinder-quobyte-87db33ed-2d62-4904-b408-de7f7ecd8726" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-903bb3b2-f866-411a-b1f8-fde242cd998a tempest-VolumesTransfersTest-616191229 None] Lock "cinder-quobyte-87db33ed-2d62-4904-b408-de7f7ecd8726" acquired by "delete_volume" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:48 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[09efe850-f3db-459d-acf9-f700541b0901]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-903bb3b2-f866-411a-b1f8-fde242cd998a tempest-VolumesTransfersTest-616191229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87db33ed-2d62-4904-b408-de7f7ecd8726 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:48 devstack sudo[91600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87db33ed-2d62-4904-b408-de7f7ecd8726
Sep 16 16:11:48 devstack sudo[91600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:49 devstack sudo[91600]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-903bb3b2-f866-411a-b1f8-fde242cd998a tempest-VolumesTransfersTest-616191229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87db33ed-2d62-4904-b408-de7f7ecd8726" returned: 0 in 0.484s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-903bb3b2-f866-411a-b1f8-fde242cd998a tempest-VolumesTransfersTest-616191229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87db33ed-2d62-4904-b408-de7f7ecd8726 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:49 devstack sudo[91605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87db33ed-2d62-4904-b408-de7f7ecd8726
Sep 16 16:11:49 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:49 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-903bb3b2-f866-411a-b1f8-fde242cd998a tempest-VolumesTransfersTest-616191229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87db33ed-2d62-4904-b408-de7f7ecd8726" returned: 0 in 0.292s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:49 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-903bb3b2-f866-411a-b1f8-fde242cd998a tempest-VolumesTransfersTest-616191229 None] Lock "cinder-quobyte-87db33ed-2d62-4904-b408-de7f7ecd8726" released by "delete_volume" :: held 0.838s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:49 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-903bb3b2-f866-411a-b1f8-fde242cd998a tempest-VolumesTransfersTest-616191229 None] Created reservations ['f96496cf-677c-43ee-a0ca-ec908d43eae9', 'db307c37-f39e-4196-bd34-223dedcc1e32', '60048386-04e8-43b7-afbe-81ae6719d5e1', '4d2dd017-0c5b-4d88-8272-24c3ae9409d6'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:11:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-903bb3b2-f866-411a-b1f8-fde242cd998a tempest-VolumesTransfersTest-616191229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-903bb3b2-f866-411a-b1f8-fde242cd998a tempest-VolumesTransfersTest-616191229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-903bb3b2-f866-411a-b1f8-fde242cd998a tempest-VolumesTransfersTest-616191229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-903bb3b2-f866-411a-b1f8-fde242cd998a tempest-VolumesTransfersTest-616191229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-903bb3b2-f866-411a-b1f8-fde242cd998a tempest-VolumesTransfersTest-616191229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-903bb3b2-f866-411a-b1f8-fde242cd998a tempest-VolumesTransfersTest-616191229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:49 devstack sudo[91608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:11:49 devstack sudo[91608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:49 devstack sudo[91608]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-903bb3b2-f866-411a-b1f8-fde242cd998a tempest-VolumesTransfersTest-616191229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.365s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:49 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-903bb3b2-f866-411a-b1f8-fde242cd998a tempest-VolumesTransfersTest-616191229 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:11:50 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-903bb3b2-f866-411a-b1f8-fde242cd998a tempest-VolumesTransfersTest-616191229 None] Deleted volume successfully.
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-903bb3b2-f866-411a-b1f8-fde242cd998a tempest-VolumesTransfersTest-616191229 None] Lock "cinder-87db33ed-2d62-4904-b408-de7f7ecd8726-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Flow 'volume_create_manager' (06faf4b6-4302-4b2f-9178-0f7969d7a921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6df2f4-b6ee-41e9-8315-4e5359c028c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6df2f4-b6ee-41e9-8315-4e5359c028c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1481249588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c14648-7f30-4b90-8c69-952783fc0dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edafe0cb63e546b78670a7345e8008ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:50Z,use_quota=True,user_id='84f08c87d61f4f5f9aa7268c2b6f5473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb2bf06-c51a-4932-8d4a-0d243d6cf3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb2bf06-c51a-4932-8d4a-0d243d6cf3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a91962-bfe1-4999-9f55-a7d37d2b1e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a91962-bfe1-4999-9f55-a7d37d2b1e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32c14648-7f30-4b90-8c69-952783fc0dfe', 'volume_name': 'volume-32c14648-7f30-4b90-8c69-952783fc0dfe', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba233ecc-dfa3-4002-95fe-2703db8915d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba233ecc-dfa3-4002-95fe-2703db8915d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e76cd8b-f05a-4f5e-bd21-4e7b9d9354df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:50 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Volume 32c14648-7f30-4b90-8c69-952783fc0dfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32c14648-7f30-4b90-8c69-952783fc0dfe', 'volume_size': 1}
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1481249588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c14648-7f30-4b90-8c69-952783fc0dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edafe0cb63e546b78670a7345e8008ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:50Z,use_quota=True,user_id='84f08c87d61f4f5f9aa7268c2b6f5473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Creating volume 32c14648-7f30-4b90-8c69-952783fc0dfe {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:11:50 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:11:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-32c14648-7f30-4b90-8c69-952783fc0dfe 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:50 devstack sudo[91618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-32c14648-7f30-4b90-8c69-952783fc0dfe 1073741824
Sep 16 16:11:50 devstack sudo[91618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:51 devstack sudo[91618]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-32c14648-7f30-4b90-8c69-952783fc0dfe 1073741824" returned: 0 in 0.625s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-32c14648-7f30-4b90-8c69-952783fc0dfe {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:51 devstack sudo[91651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-32c14648-7f30-4b90-8c69-952783fc0dfe
Sep 16 16:11:51 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:51 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-32c14648-7f30-4b90-8c69-952783fc0dfe" returned: 0 in 0.328s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:11:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e76cd8b-f05a-4f5e-bd21-4e7b9d9354df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32c14648-7f30-4b90-8c69-952783fc0dfe', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f18374c-9f6d-449f-ad27-05e36d330674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:51 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Volume volume-32c14648-7f30-4b90-8c69-952783fc0dfe (32c14648-7f30-4b90-8c69-952783fc0dfe): created successfully
Sep 16 16:11:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f18374c-9f6d-449f-ad27-05e36d330674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Flow 'volume_create_manager' (06faf4b6-4302-4b2f-9178-0f7969d7a921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:11:51 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-1fe4a3fc-66f8-425c-9f8d-d1d49206d9d5 tempest-VolumesTransfersTest-1256361367 None] Created volume successfully.
Sep 16 16:11:51 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-4f8df46f-8257-4bb0-8946-d028d89271c4 tempest-GroupSnapshotsV319Test-8214741 None] Group tempest-GroupSnapshotsV319Test-Group-1367092787: creating
Sep 16 16:11:51 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-4f8df46f-8257-4bb0-8946-d028d89271c4 tempest-GroupSnapshotsV319Test-8214741 None] Group tempest-GroupSnapshotsV319Test-Group-1367092787: created successfully
Sep 16 16:11:52 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-4f8df46f-8257-4bb0-8946-d028d89271c4 tempest-GroupSnapshotsV319Test-8214741 None] Create group completed successfully.
Sep 16 16:11:52 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-217ca7b3-7c4a-4232-bcc0-828d829e00d4 tempest-VolumesTransfersTest-616191229 None] Acquiring lock "cinder-32c14648-7f30-4b90-8c69-952783fc0dfe-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:52 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-217ca7b3-7c4a-4232-bcc0-828d829e00d4 tempest-VolumesTransfersTest-616191229 None] Lock "cinder-32c14648-7f30-4b90-8c69-952783fc0dfe-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:52 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-217ca7b3-7c4a-4232-bcc0-828d829e00d4 tempest-VolumesTransfersTest-616191229 None] Acquiring lock "cinder-quobyte-32c14648-7f30-4b90-8c69-952783fc0dfe" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:52 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-217ca7b3-7c4a-4232-bcc0-828d829e00d4 tempest-VolumesTransfersTest-616191229 None] Lock "cinder-quobyte-32c14648-7f30-4b90-8c69-952783fc0dfe" acquired by "delete_volume" :: waited 0.015s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:52 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69cc563-57b4-4a36-8b96-d126946bd8ae]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-217ca7b3-7c4a-4232-bcc0-828d829e00d4 tempest-VolumesTransfersTest-616191229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-32c14648-7f30-4b90-8c69-952783fc0dfe {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:52 devstack sudo[91655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-32c14648-7f30-4b90-8c69-952783fc0dfe
Sep 16 16:11:52 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:53 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-217ca7b3-7c4a-4232-bcc0-828d829e00d4 tempest-VolumesTransfersTest-616191229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-32c14648-7f30-4b90-8c69-952783fc0dfe" returned: 0 in 0.372s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-217ca7b3-7c4a-4232-bcc0-828d829e00d4 tempest-VolumesTransfersTest-616191229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-32c14648-7f30-4b90-8c69-952783fc0dfe {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:53 devstack sudo[91660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-32c14648-7f30-4b90-8c69-952783fc0dfe
Sep 16 16:11:53 devstack sudo[91660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:53 devstack sudo[91660]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-217ca7b3-7c4a-4232-bcc0-828d829e00d4 tempest-VolumesTransfersTest-616191229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-32c14648-7f30-4b90-8c69-952783fc0dfe" returned: 0 in 0.294s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-217ca7b3-7c4a-4232-bcc0-828d829e00d4 tempest-VolumesTransfersTest-616191229 None] Lock "cinder-quobyte-32c14648-7f30-4b90-8c69-952783fc0dfe" released by "delete_volume" :: held 0.730s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-217ca7b3-7c4a-4232-bcc0-828d829e00d4 tempest-VolumesTransfersTest-616191229 None] Created reservations ['12107517-ac58-441a-ae34-fde0bac5025f', '1ba1ba50-197c-4178-a2a6-097fbabb1fab', 'c2e51320-f9b6-4888-bc3c-ebc0fd618b32', '241354f4-b789-4fdc-b4dc-d076bea376d0'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Flow 'volume_create_manager' (0437b4b5-cf5a-49cb-8f37-6e6aea339c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89714439-515a-4c81-9c96-bbfe337cb591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89714439-515a-4c81-9c96-bbfe337cb591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1135820737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6d8f83ca-fbf6-4eca-acbd-0ebf17aefe16,host='devstack@QuobyteHD#QuobyteHD',id=b55ba324-216f-458e-b137-2bafc920dc7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426e74dae5a24150b962405bc0bd3f1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:54Z,use_quota=True,user_id='7d260fc6fe724a3e85247f7cd354b3a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcdadc56-9d3e-453e-875d-0e95686048f4),volume_type_id=bcdadc56-9d3e-453e-875d-0e95686048f4)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ac0e24-1248-4905-8ecc-b8ebd0cf63eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ac0e24-1248-4905-8ecc-b8ebd0cf63eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2deae015-fa51-482c-bfa4-b3044cc57fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2deae015-fa51-482c-bfa4-b3044cc57fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b55ba324-216f-458e-b137-2bafc920dc7c', 'volume_name': 'volume-b55ba324-216f-458e-b137-2bafc920dc7c', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5188acf0-761f-44db-97cd-ee035e38214e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5188acf0-761f-44db-97cd-ee035e38214e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780c4950-1202-45ba-b6b5-d89c9ebb6be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:53 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Volume b55ba324-216f-458e-b137-2bafc920dc7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b55ba324-216f-458e-b137-2bafc920dc7c', 'volume_size': 1}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6d8f83ca-fbf6-4eca-acbd-0ebf17aefe16,created_at=2026-09-16T14:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1135820737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6d8f83ca-fbf6-4eca-acbd-0ebf17aefe16,host='devstack@QuobyteHD#QuobyteHD',id=b55ba324-216f-458e-b137-2bafc920dc7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426e74dae5a24150b962405bc0bd3f1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:54Z,use_quota=True,user_id='7d260fc6fe724a3e85247f7cd354b3a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcdadc56-9d3e-453e-875d-0e95686048f4),volume_type_id=bcdadc56-9d3e-453e-875d-0e95686048f4)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Creating volume b55ba324-216f-458e-b137-2bafc920dc7c {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:11:53 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-217ca7b3-7c4a-4232-bcc0-828d829e00d4 tempest-VolumesTransfersTest-616191229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-217ca7b3-7c4a-4232-bcc0-828d829e00d4 tempest-VolumesTransfersTest-616191229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-217ca7b3-7c4a-4232-bcc0-828d829e00d4 tempest-VolumesTransfersTest-616191229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:53 devstack sudo[91663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c 1073741824
Sep 16 16:11:53 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-217ca7b3-7c4a-4232-bcc0-828d829e00d4 tempest-VolumesTransfersTest-616191229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-217ca7b3-7c4a-4232-bcc0-828d829e00d4 tempest-VolumesTransfersTest-616191229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-217ca7b3-7c4a-4232-bcc0-828d829e00d4 tempest-VolumesTransfersTest-616191229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:53 devstack sudo[91665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:11:53 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:54 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-217ca7b3-7c4a-4232-bcc0-828d829e00d4 tempest-VolumesTransfersTest-616191229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.296s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:54 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-217ca7b3-7c4a-4232-bcc0-828d829e00d4 tempest-VolumesTransfersTest-616191229 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:11:54 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-217ca7b3-7c4a-4232-bcc0-828d829e00d4 tempest-VolumesTransfersTest-616191229 None] Deleted volume successfully.
Sep 16 16:11:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-217ca7b3-7c4a-4232-bcc0-828d829e00d4 tempest-VolumesTransfersTest-616191229 None] Lock "cinder-32c14648-7f30-4b90-8c69-952783fc0dfe-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:11:54 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c 1073741824" returned: 0 in 0.558s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:54 devstack sudo[91672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c
Sep 16 16:11:54 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:54 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c" returned: 0 in 0.253s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:11:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780c4950-1202-45ba-b6b5-d89c9ebb6be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b55ba324-216f-458e-b137-2bafc920dc7c', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab73ea7-a732-46da-ab6f-aa8abdd0f2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:54 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Volume volume-b55ba324-216f-458e-b137-2bafc920dc7c (b55ba324-216f-458e-b137-2bafc920dc7c): created successfully
Sep 16 16:11:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab73ea7-a732-46da-ab6f-aa8abdd0f2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Flow 'volume_create_manager' (0437b4b5-cf5a-49cb-8f37-6e6aea339c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:11:54 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-acb05170-e15b-4d89-a67f-12ade2062f4b tempest-GroupSnapshotsV319Test-8214741 None] Created volume successfully.
Sep 16 16:11:55 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-42b51178-6ef4-4ad5-b6aa-4cb5fb95efb1 tempest-GroupSnapshotsV319Test-8214741 None] GroupSnapshot e2b6c17e-f400-4954-ad63-78628d1ffbcb: creating.
Sep 16 16:11:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-42b51178-6ef4-4ad5-b6aa-4cb5fb95efb1 tempest-GroupSnapshotsV319Test-8214741 None] Group snapshot e2b6c17e-f400-4954-ad63-78628d1ffbcb: creating. {{(pid=86165) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 16 16:11:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-42b51178-6ef4-4ad5-b6aa-4cb5fb95efb1 tempest-GroupSnapshotsV319Test-8214741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-42b51178-6ef4-4ad5-b6aa-4cb5fb95efb1 tempest-GroupSnapshotsV319Test-8214741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:55 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-42b51178-6ef4-4ad5-b6aa-4cb5fb95efb1 tempest-GroupSnapshotsV319Test-8214741 None] Creating offline snapshot 174f0f26-1b9a-43a0-b541-960875d4f8f7 of volume b55ba324-216f-458e-b137-2bafc920dc7c {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:11:55 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec902c7-bb4c-485a-ba04-44a7153dec72]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42b51178-6ef4-4ad5-b6aa-4cb5fb95efb1 tempest-GroupSnapshotsV319Test-8214741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:55 devstack sudo[91711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c
Sep 16 16:11:55 devstack sudo[91711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:55 devstack sudo[91711]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42b51178-6ef4-4ad5-b6aa-4cb5fb95efb1 tempest-GroupSnapshotsV319Test-8214741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c" returned: 0 in 0.393s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42b51178-6ef4-4ad5-b6aa-4cb5fb95efb1 tempest-GroupSnapshotsV319Test-8214741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.174f0f26-1b9a-43a0-b541-960875d4f8f7 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:55 devstack sudo[91740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.174f0f26-1b9a-43a0-b541-960875d4f8f7 1G
Sep 16 16:11:55 devstack sudo[91740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:56 devstack sudo[91740]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42b51178-6ef4-4ad5-b6aa-4cb5fb95efb1 tempest-GroupSnapshotsV319Test-8214741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.174f0f26-1b9a-43a0-b541-960875d4f8f7 1G" returned: 0 in 0.462s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42b51178-6ef4-4ad5-b6aa-4cb5fb95efb1 tempest-GroupSnapshotsV319Test-8214741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55ba324-216f-458e-b137-2bafc920dc7c -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.174f0f26-1b9a-43a0-b541-960875d4f8f7 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:56 devstack sudo[91746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55ba324-216f-458e-b137-2bafc920dc7c -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.174f0f26-1b9a-43a0-b541-960875d4f8f7
Sep 16 16:11:56 devstack sudo[91746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:56 devstack sudo[91746]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42b51178-6ef4-4ad5-b6aa-4cb5fb95efb1 tempest-GroupSnapshotsV319Test-8214741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b55ba324-216f-458e-b137-2bafc920dc7c -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.174f0f26-1b9a-43a0-b541-960875d4f8f7" returned: 0 in 0.396s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:56 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-42b51178-6ef4-4ad5-b6aa-4cb5fb95efb1 tempest-GroupSnapshotsV319Test-8214741 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.174f0f26-1b9a-43a0-b541-960875d4f8f7 is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 16:11:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42b51178-6ef4-4ad5-b6aa-4cb5fb95efb1 tempest-GroupSnapshotsV319Test-8214741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.174f0f26-1b9a-43a0-b541-960875d4f8f7 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:56 devstack sudo[91751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.174f0f26-1b9a-43a0-b541-960875d4f8f7
Sep 16 16:11:56 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:56 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:11:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Flow 'volume_create_manager' (ca8a9f1f-f4a8-43c3-8a2d-929379937a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:11:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5086d068-36f2-4891-9700-4a5aca240d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5086d068-36f2-4891-9700-4a5aca240d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1271192087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3ce51b-4f20-4701-8147-58ba62050722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e7f68cbb9f498a83fccd4ca11cb214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:57Z,use_quota=True,user_id='39fcb885ec484bd781682d6d46e8e132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a5a1fa8-a7f4-4caf-87ef-13aebb192496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a5a1fa8-a7f4-4caf-87ef-13aebb192496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6383f3d9-ef5e-44e6-aeb1-1a404468a9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6383f3d9-ef5e-44e6-aeb1-1a404468a9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a3ce51b-4f20-4701-8147-58ba62050722', 'volume_name': 'volume-8a3ce51b-4f20-4701-8147-58ba62050722', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00152756-dc5d-4088-b611-67fae4b32d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00152756-dc5d-4088-b611-67fae4b32d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa1fb93-1702-4475-a335-ccfa225a7d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:56 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Volume 8a3ce51b-4f20-4701-8147-58ba62050722: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a3ce51b-4f20-4701-8147-58ba62050722', 'volume_size': 1}
Sep 16 16:11:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:56 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42b51178-6ef4-4ad5-b6aa-4cb5fb95efb1 tempest-GroupSnapshotsV319Test-8214741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.174f0f26-1b9a-43a0-b541-960875d4f8f7" returned: 0 in 0.251s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42b51178-6ef4-4ad5-b6aa-4cb5fb95efb1 tempest-GroupSnapshotsV319Test-8214741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:56 devstack sudo[91754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.info
Sep 16 16:11:56 devstack sudo[91754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:57 devstack sudo[91754]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42b51178-6ef4-4ad5-b6aa-4cb5fb95efb1 tempest-GroupSnapshotsV319Test-8214741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.info" returned: 0 in 0.255s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:57 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-42b51178-6ef4-4ad5-b6aa-4cb5fb95efb1 tempest-GroupSnapshotsV319Test-8214741 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 16:11:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42b51178-6ef4-4ad5-b6aa-4cb5fb95efb1 tempest-GroupSnapshotsV319Test-8214741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:57 devstack sudo[91757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.info
Sep 16 16:11:57 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:57 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42b51178-6ef4-4ad5-b6aa-4cb5fb95efb1 tempest-GroupSnapshotsV319Test-8214741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.info" returned: 0 in 0.256s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-42b51178-6ef4-4ad5-b6aa-4cb5fb95efb1 tempest-GroupSnapshotsV319Test-8214741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.102s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.676s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:57 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1271192087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3ce51b-4f20-4701-8147-58ba62050722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e7f68cbb9f498a83fccd4ca11cb214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:57Z,use_quota=True,user_id='39fcb885ec484bd781682d6d46e8e132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:11:57 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Creating volume 8a3ce51b-4f20-4701-8147-58ba62050722 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:11:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:57 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:11:57 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:11:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:57 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:11:57 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:11:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:57 devstack sudo[91760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722 1073741824
Sep 16 16:11:57 devstack sudo[91760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:57 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-42b51178-6ef4-4ad5-b6aa-4cb5fb95efb1 tempest-GroupSnapshotsV319Test-8214741 None] group_snapshot e2b6c17e-f400-4954-ad63-78628d1ffbcb: created successfully
Sep 16 16:11:57 devstack sudo[91760]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722 1073741824" returned: 0 in 0.548s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:57 devstack sudo[91766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722
Sep 16 16:11:57 devstack sudo[91766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:58 devstack sudo[91766]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722" returned: 0 in 0.276s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:58 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:11:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:11:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa1fb93-1702-4475-a335-ccfa225a7d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a3ce51b-4f20-4701-8147-58ba62050722', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fde89a-fd8c-4e3d-a316-b54442df8a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:11:58 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Volume volume-8a3ce51b-4f20-4701-8147-58ba62050722 (8a3ce51b-4f20-4701-8147-58ba62050722): created successfully
Sep 16 16:11:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fde89a-fd8c-4e3d-a316-b54442df8a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:11:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Flow 'volume_create_manager' (ca8a9f1f-f4a8-43c3-8a2d-929379937a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:11:58 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-2652c5b3-3111-42bb-bb8c-c2c5ff51aad4 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Created volume successfully.
Sep 16 16:11:58 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] group_snapshot e2b6c17e-f400-4954-ad63-78628d1ffbcb: deleting
Sep 16 16:11:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] group_snapshot e2b6c17e-f400-4954-ad63-78628d1ffbcb: deleting {{(pid=86165) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 16 16:11:58 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] Acquiring lock "cinder-quobyte-b55ba324-216f-458e-b137-2bafc920dc7c" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4ab91a11-beea-4325-a377-eddb549ff0dd tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:11:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4ab91a11-beea-4325-a377-eddb549ff0dd tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:11:58 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] Lock "cinder-quobyte-b55ba324-216f-458e-b137-2bafc920dc7c" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:58 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] Acquiring lock "cinder-quobyte-174f0f26-1b9a-43a0-b541-960875d4f8f7" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:11:58 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-4ab91a11-beea-4325-a377-eddb549ff0dd tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Creating offline snapshot c156424f-4c6c-4c80-b7be-24e66f773aba of volume 8a3ce51b-4f20-4701-8147-58ba62050722 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:11:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] Lock "cinder-quobyte-174f0f26-1b9a-43a0-b541-960875d4f8f7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:11:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] Deleting offline snapshot 174f0f26-1b9a-43a0-b541-960875d4f8f7 of volume b55ba324-216f-458e-b137-2bafc920dc7c {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:11:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] snapshot_file for this snap is: volume-b55ba324-216f-458e-b137-2bafc920dc7c.174f0f26-1b9a-43a0-b541-960875d4f8f7 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:11:59 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[407b7776-1063-4772-bd5b-2473d9575fae]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4ab91a11-beea-4325-a377-eddb549ff0dd tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:59 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7889f9-6b5f-4d20-b5af-c8ae58565c7d]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.174f0f26-1b9a-43a0-b541-960875d4f8f7 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:59 devstack sudo[91769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722
Sep 16 16:11:59 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:59 devstack sudo[91770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.174f0f26-1b9a-43a0-b541-960875d4f8f7
Sep 16 16:11:59 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:59 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4ab91a11-beea-4325-a377-eddb549ff0dd tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722" returned: 0 in 0.477s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4ab91a11-beea-4325-a377-eddb549ff0dd tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.c156424f-4c6c-4c80-b7be-24e66f773aba 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:59 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.174f0f26-1b9a-43a0-b541-960875d4f8f7" returned: 0 in 0.473s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b55ba324-216f-458e-b137-2bafc920dc7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:11:59 devstack sudo[91779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.c156424f-4c6c-4c80-b7be-24e66f773aba 1G
Sep 16 16:11:59 devstack sudo[91779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:59 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bde032-dcf3-42e9-82d1-d37358274a17]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:11:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:11:59 devstack sudo[91781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c
Sep 16 16:11:59 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:11:59 devstack sudo[91779]: pam_unix(sudo:session): session closed for user root
Sep 16 16:11:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4ab91a11-beea-4325-a377-eddb549ff0dd tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.c156424f-4c6c-4c80-b7be-24e66f773aba 1G" returned: 0 in 0.477s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:11:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4ab91a11-beea-4325-a377-eddb549ff0dd tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a3ce51b-4f20-4701-8147-58ba62050722 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.c156424f-4c6c-4c80-b7be-24e66f773aba {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:00 devstack sudo[91791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a3ce51b-4f20-4701-8147-58ba62050722 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.c156424f-4c6c-4c80-b7be-24e66f773aba
Sep 16 16:12:00 devstack sudo[91791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:00 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c" returned: 0 in 0.450s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.174f0f26-1b9a-43a0-b541-960875d4f8f7 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:00 devstack sudo[91794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.174f0f26-1b9a-43a0-b541-960875d4f8f7
Sep 16 16:12:00 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:00 devstack sudo[91791]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4ab91a11-beea-4325-a377-eddb549ff0dd tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a3ce51b-4f20-4701-8147-58ba62050722 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.c156424f-4c6c-4c80-b7be-24e66f773aba" returned: 0 in 0.331s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:00 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-4ab91a11-beea-4325-a377-eddb549ff0dd tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.c156424f-4c6c-4c80-b7be-24e66f773aba is being set with open permissions: ugo+rw
Sep 16 16:12:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4ab91a11-beea-4325-a377-eddb549ff0dd tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.c156424f-4c6c-4c80-b7be-24e66f773aba {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:00 devstack sudo[91804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.c156424f-4c6c-4c80-b7be-24e66f773aba
Sep 16 16:12:00 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:00 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.174f0f26-1b9a-43a0-b541-960875d4f8f7" returned: 0 in 0.434s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.174f0f26-1b9a-43a0-b541-960875d4f8f7 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:00 devstack sudo[91806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.174f0f26-1b9a-43a0-b541-960875d4f8f7
Sep 16 16:12:00 devstack sudo[91806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:00 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4ab91a11-beea-4325-a377-eddb549ff0dd tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.c156424f-4c6c-4c80-b7be-24e66f773aba" returned: 0 in 0.307s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4ab91a11-beea-4325-a377-eddb549ff0dd tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:00 devstack sudo[91809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.info
Sep 16 16:12:00 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:00 devstack sudo[91806]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c.174f0f26-1b9a-43a0-b541-960875d4f8f7" returned: 0 in 0.280s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] Lock "cinder-quobyte-174f0f26-1b9a-43a0-b541-960875d4f8f7" released by "_delete_snapshot" :: held 1.781s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:12:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] Lock "cinder-quobyte-b55ba324-216f-458e-b137-2bafc920dc7c" released by "delete_snapshot" :: held 1.811s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:12:00 devstack cinder-volume[86165]: WARNING cinder.quota [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1663299947 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1663299947, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:12:00 devstack cinder-volume[86165]: WARNING cinder.quota [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1663299947 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1663299947, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:12:00 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] Created reservations ['c0b2f464-e064-4c93-9573-2ba1173e26a2', 'baee086d-b48d-4c82-abd1-6b8b356bcb3e', '803b87ca-1783-4491-967f-72977fba4b9c', '6cf681e3-51ea-4b4a-96bd-a265bf2da27d'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:12:01 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4ab91a11-beea-4325-a377-eddb549ff0dd tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.info" returned: 0 in 0.328s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:01 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-4ab91a11-beea-4325-a377-eddb549ff0dd tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.info is being set with open permissions: ugo+rw
Sep 16 16:12:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4ab91a11-beea-4325-a377-eddb549ff0dd tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:01 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-81a52b6e-6657-4195-8436-b8e7657e3f87 tempest-GroupSnapshotsV319Test-8214741 None] group_snapshot e2b6c17e-f400-4954-ad63-78628d1ffbcb: deleted successfully
Sep 16 16:12:01 devstack sudo[91814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.info
Sep 16 16:12:01 devstack sudo[91814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:01 devstack sudo[91814]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4ab91a11-beea-4325-a377-eddb549ff0dd tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.info" returned: 0 in 0.272s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4ab91a11-beea-4325-a377-eddb549ff0dd tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.341s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:01 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-4ab91a11-beea-4325-a377-eddb549ff0dd tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Create snapshot completed successfully
Sep 16 16:12:01 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-f2cd9fe7-f33d-40d9-bb7d-cd0c856d76d4 req-0123a7e2-9c02-4295-b8ba-5d16738428f1 tempest-ServerActionsTestOtherA-2007622607 None] Terminate volume connection completed successfully.
Sep 16 16:12:01 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-f2cd9fe7-f33d-40d9-bb7d-cd0c856d76d4 req-0123a7e2-9c02-4295-b8ba-5d16738428f1 tempest-ServerActionsTestOtherA-2007622607 None] Deleting attachment 3a03f6d4-cdd9-4ace-be53-ab6af0c01d61. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:12:01 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ba86eaf7-9e9f-4540-9226-bfded362a4d9 tempest-GroupSnapshotsV319Test-8214741 None] Acquiring lock "cinder-quobyte-b55ba324-216f-458e-b137-2bafc920dc7c" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:12:01 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ba86eaf7-9e9f-4540-9226-bfded362a4d9 tempest-GroupSnapshotsV319Test-8214741 None] Lock "cinder-quobyte-b55ba324-216f-458e-b137-2bafc920dc7c" acquired by "delete_volume" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:12:01 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c73803e-1b89-4003-9c6a-ef05eb4b2cad]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:12:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ba86eaf7-9e9f-4540-9226-bfded362a4d9 tempest-GroupSnapshotsV319Test-8214741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:01 devstack sudo[91821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c
Sep 16 16:12:01 devstack sudo[91821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:02 devstack sudo[91821]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ba86eaf7-9e9f-4540-9226-bfded362a4d9 tempest-GroupSnapshotsV319Test-8214741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c" returned: 0 in 0.402s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ba86eaf7-9e9f-4540-9226-bfded362a4d9 tempest-GroupSnapshotsV319Test-8214741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:02 devstack sudo[91826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c
Sep 16 16:12:02 devstack sudo[91826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:02 devstack sudo[91826]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ba86eaf7-9e9f-4540-9226-bfded362a4d9 tempest-GroupSnapshotsV319Test-8214741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b55ba324-216f-458e-b137-2bafc920dc7c" returned: 0 in 0.320s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ba86eaf7-9e9f-4540-9226-bfded362a4d9 tempest-GroupSnapshotsV319Test-8214741 None] Lock "cinder-quobyte-b55ba324-216f-458e-b137-2bafc920dc7c" released by "delete_volume" :: held 0.811s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:12:02 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-ba86eaf7-9e9f-4540-9226-bfded362a4d9 tempest-GroupSnapshotsV319Test-8214741 None] Created reservations ['2b2fdb3a-63a9-492e-8f67-3a4a3718f59f'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:12:02 devstack cinder-volume[86165]: WARNING cinder.quota [None req-ba86eaf7-9e9f-4540-9226-bfded362a4d9 tempest-GroupSnapshotsV319Test-8214741 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1663299947 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1663299947, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:12:02 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-ba86eaf7-9e9f-4540-9226-bfded362a4d9 tempest-GroupSnapshotsV319Test-8214741 None] Created reservations ['4147386b-182d-4a4c-9c96-5069fd93447b', '489afefc-50e5-4a3c-ae26-772a82bbc37b', 'fe817add-0651-4b3c-87b7-67c7bea77a2d', 'be5f9802-5ecf-431e-906b-5fdfdc646deb'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:12:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-093fe3d0-ea7b-44b7-ba48-33eee9a46468 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Acquiring lock "cinder-c156424f-4c6c-4c80-b7be-24e66f773aba-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:12:02 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:12:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Flow 'volume_create_manager' (55ccbe51-c107-4796-b0b3-321a119f48d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:12:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a6852b-865f-484a-81ef-eaa29e2c0b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-093fe3d0-ea7b-44b7-ba48-33eee9a46468 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Lock "cinder-c156424f-4c6c-4c80-b7be-24e66f773aba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:12:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-093fe3d0-ea7b-44b7-ba48-33eee9a46468 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Acquiring lock "cinder-quobyte-8a3ce51b-4f20-4701-8147-58ba62050722" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:12:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-093fe3d0-ea7b-44b7-ba48-33eee9a46468 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Lock "cinder-quobyte-8a3ce51b-4f20-4701-8147-58ba62050722" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:12:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-093fe3d0-ea7b-44b7-ba48-33eee9a46468 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Acquiring lock "cinder-quobyte-c156424f-4c6c-4c80-b7be-24e66f773aba" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:12:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a6852b-865f-484a-81ef-eaa29e2c0b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-273645043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=044dd766-18cf-4485-b852-613456374610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f88eddf0e6408aa93b84927abd105b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:03Z,use_quota=True,user_id='fa9f5fef4484425db71b0dd8ed4909e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8970cd62-3d63-40b0-bafb-385a3b0ffe2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8970cd62-3d63-40b0-bafb-385a3b0ffe2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e821912d-2f19-472b-b169-8d435b0b3064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e821912d-2f19-472b-b169-8d435b0b3064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '044dd766-18cf-4485-b852-613456374610', 'volume_name': 'volume-044dd766-18cf-4485-b852-613456374610', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d29b376f-bf29-48a0-aacf-5e851d7cb488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d29b376f-bf29-48a0-aacf-5e851d7cb488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (575804c4-540a-48b0-b72b-335fc3fcdf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:03 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Volume 044dd766-18cf-4485-b852-613456374610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-044dd766-18cf-4485-b852-613456374610', 'volume_size': 1}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-273645043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=044dd766-18cf-4485-b852-613456374610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f88eddf0e6408aa93b84927abd105b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:03Z,use_quota=True,user_id='fa9f5fef4484425db71b0dd8ed4909e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Creating volume 044dd766-18cf-4485-b852-613456374610 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:12:03 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-044dd766-18cf-4485-b852-613456374610 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ba86eaf7-9e9f-4540-9226-bfded362a4d9 tempest-GroupSnapshotsV319Test-8214741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ba86eaf7-9e9f-4540-9226-bfded362a4d9 tempest-GroupSnapshotsV319Test-8214741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ba86eaf7-9e9f-4540-9226-bfded362a4d9 tempest-GroupSnapshotsV319Test-8214741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:12:03 devstack sudo[91846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-044dd766-18cf-4485-b852-613456374610 1073741824
Sep 16 16:12:03 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ba86eaf7-9e9f-4540-9226-bfded362a4d9 tempest-GroupSnapshotsV319Test-8214741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ba86eaf7-9e9f-4540-9226-bfded362a4d9 tempest-GroupSnapshotsV319Test-8214741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ba86eaf7-9e9f-4540-9226-bfded362a4d9 tempest-GroupSnapshotsV319Test-8214741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-093fe3d0-ea7b-44b7-ba48-33eee9a46468 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Lock "cinder-quobyte-c156424f-4c6c-4c80-b7be-24e66f773aba" acquired by "_delete_snapshot" :: waited 0.171s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:12:03 devstack sudo[91851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:12:03 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-093fe3d0-ea7b-44b7-ba48-33eee9a46468 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Deleting offline snapshot c156424f-4c6c-4c80-b7be-24e66f773aba of volume 8a3ce51b-4f20-4701-8147-58ba62050722 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-093fe3d0-ea7b-44b7-ba48-33eee9a46468 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] snapshot_file for this snap is: volume-8a3ce51b-4f20-4701-8147-58ba62050722.c156424f-4c6c-4c80-b7be-24e66f773aba {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8289a210-0451-4334-89fc-dccc5a28efe4]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-093fe3d0-ea7b-44b7-ba48-33eee9a46468 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.c156424f-4c6c-4c80-b7be-24e66f773aba {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:03 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ba86eaf7-9e9f-4540-9226-bfded362a4d9 tempest-GroupSnapshotsV319Test-8214741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.319s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-ba86eaf7-9e9f-4540-9226-bfded362a4d9 tempest-GroupSnapshotsV319Test-8214741 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:12:03 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-ba86eaf7-9e9f-4540-9226-bfded362a4d9 tempest-GroupSnapshotsV319Test-8214741 None] Delete group completed successfully.
Sep 16 16:12:03 devstack sudo[91856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.c156424f-4c6c-4c80-b7be-24e66f773aba
Sep 16 16:12:03 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:03 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-044dd766-18cf-4485-b852-613456374610 1073741824" returned: 0 in 0.630s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-044dd766-18cf-4485-b852-613456374610 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:03 devstack sudo[91870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-044dd766-18cf-4485-b852-613456374610
Sep 16 16:12:03 devstack sudo[91870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:03 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-093fe3d0-ea7b-44b7-ba48-33eee9a46468 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.c156424f-4c6c-4c80-b7be-24e66f773aba" returned: 0 in 0.569s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-093fe3d0-ea7b-44b7-ba48-33eee9a46468 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a3ce51b-4f20-4701-8147-58ba62050722(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d74b80-15b9-4cfd-9a51-f443cbb8a39b]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:12:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-093fe3d0-ea7b-44b7-ba48-33eee9a46468 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:04 devstack sudo[91873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722
Sep 16 16:12:04 devstack sudo[91873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:04 devstack sudo[91870]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-044dd766-18cf-4485-b852-613456374610" returned: 0 in 0.393s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:04 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:12:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:04 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (575804c4-540a-48b0-b72b-335fc3fcdf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-044dd766-18cf-4485-b852-613456374610', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:04 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3410b01-f4fa-402c-b371-d713dfcddeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:04 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Volume volume-044dd766-18cf-4485-b852-613456374610 (044dd766-18cf-4485-b852-613456374610): created successfully
Sep 16 16:12:04 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3410b01-f4fa-402c-b371-d713dfcddeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:04 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Flow 'volume_create_manager' (55ccbe51-c107-4796-b0b3-321a119f48d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:12:04 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-90c8ca4c-a152-4c24-9df9-f51d37badfd7 tempest-VolumesTransfersV357Test-620793499 None] Created volume successfully.
Sep 16 16:12:04 devstack sudo[91873]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-093fe3d0-ea7b-44b7-ba48-33eee9a46468 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722" returned: 0 in 0.514s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-093fe3d0-ea7b-44b7-ba48-33eee9a46468 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.c156424f-4c6c-4c80-b7be-24e66f773aba {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:04 devstack sudo[91881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.c156424f-4c6c-4c80-b7be-24e66f773aba
Sep 16 16:12:04 devstack sudo[91881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:04 devstack sudo[91881]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-093fe3d0-ea7b-44b7-ba48-33eee9a46468 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.c156424f-4c6c-4c80-b7be-24e66f773aba" returned: 0 in 0.452s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-093fe3d0-ea7b-44b7-ba48-33eee9a46468 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.c156424f-4c6c-4c80-b7be-24e66f773aba {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:04 devstack sudo[91889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.c156424f-4c6c-4c80-b7be-24e66f773aba
Sep 16 16:12:04 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:05 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-093fe3d0-ea7b-44b7-ba48-33eee9a46468 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722.c156424f-4c6c-4c80-b7be-24e66f773aba" returned: 0 in 0.290s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-093fe3d0-ea7b-44b7-ba48-33eee9a46468 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Lock "cinder-quobyte-c156424f-4c6c-4c80-b7be-24e66f773aba" released by "_delete_snapshot" :: held 2.039s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:12:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-093fe3d0-ea7b-44b7-ba48-33eee9a46468 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Lock "cinder-quobyte-8a3ce51b-4f20-4701-8147-58ba62050722" released by "delete_snapshot" :: held 2.227s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:12:05 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-093fe3d0-ea7b-44b7-ba48-33eee9a46468 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Created reservations ['9e87c7c9-4e6a-479a-9ecc-bcd3d7a058a7', 'd8fc72d5-0806-4c8f-9939-ea56f542ac9a', 'bba4b5a1-6073-4406-a40c-6a45b978e973', '1ed4245c-4332-412b-88d7-9faf740eb9b1'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:12:05 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-093fe3d0-ea7b-44b7-ba48-33eee9a46468 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Delete snapshot completed successfully.
Sep 16 16:12:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-093fe3d0-ea7b-44b7-ba48-33eee9a46468 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Lock "cinder-c156424f-4c6c-4c80-b7be-24e66f773aba-delete_snapshot" released by "delete_snapshot" :: held 2.466s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:12:06 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-32c89c83-9bf6-43ff-a791-5fdc765a31b2 tempest-VolumesTransfersV357Test-348046462 None] Transfer volume completed successfully.
Sep 16 16:12:06 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d8e7d991-218b-4f8b-8d27-0765b48499a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Acquiring lock "cinder-8a3ce51b-4f20-4701-8147-58ba62050722-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:12:06 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d8e7d991-218b-4f8b-8d27-0765b48499a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Lock "cinder-8a3ce51b-4f20-4701-8147-58ba62050722-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:12:06 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d8e7d991-218b-4f8b-8d27-0765b48499a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Acquiring lock "cinder-quobyte-8a3ce51b-4f20-4701-8147-58ba62050722" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:12:06 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d8e7d991-218b-4f8b-8d27-0765b48499a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Lock "cinder-quobyte-8a3ce51b-4f20-4701-8147-58ba62050722" acquired by "delete_volume" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:12:06 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6ffa50-e5b1-41b3-98f1-05c78c8daa10]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:12:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d8e7d991-218b-4f8b-8d27-0765b48499a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:06 devstack sudo[91893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722
Sep 16 16:12:06 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:06 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d8e7d991-218b-4f8b-8d27-0765b48499a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722" returned: 0 in 0.453s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d8e7d991-218b-4f8b-8d27-0765b48499a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:06 devstack sudo[91898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722
Sep 16 16:12:06 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:06 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2211aee3-6e67-4615-9c8f-f84de579568f tempest-VolumesTransfersV357Test-1607256338 None] Acquiring lock "cinder-044dd766-18cf-4485-b852-613456374610-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:12:06 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2211aee3-6e67-4615-9c8f-f84de579568f tempest-VolumesTransfersV357Test-1607256338 None] Lock "cinder-044dd766-18cf-4485-b852-613456374610-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:12:06 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2211aee3-6e67-4615-9c8f-f84de579568f tempest-VolumesTransfersV357Test-1607256338 None] Acquiring lock "cinder-quobyte-044dd766-18cf-4485-b852-613456374610" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:12:06 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2211aee3-6e67-4615-9c8f-f84de579568f tempest-VolumesTransfersV357Test-1607256338 None] Lock "cinder-quobyte-044dd766-18cf-4485-b852-613456374610" acquired by "delete_volume" :: waited 0.021s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:12:06 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[16630f35-b270-439d-ae73-066ced0a9bf2]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:12:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2211aee3-6e67-4615-9c8f-f84de579568f tempest-VolumesTransfersV357Test-1607256338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-044dd766-18cf-4485-b852-613456374610 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:07 devstack sudo[91900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-044dd766-18cf-4485-b852-613456374610
Sep 16 16:12:07 devstack sudo[91900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:07 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d8e7d991-218b-4f8b-8d27-0765b48499a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a3ce51b-4f20-4701-8147-58ba62050722" returned: 0 in 0.358s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d8e7d991-218b-4f8b-8d27-0765b48499a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Lock "cinder-quobyte-8a3ce51b-4f20-4701-8147-58ba62050722" released by "delete_volume" :: held 0.905s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:07 devstack sudo[91903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:12:07 devstack sudo[91903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-d8e7d991-218b-4f8b-8d27-0765b48499a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Created reservations ['cc2f8175-50d5-4117-8903-1fc67205a864', 'c1ecdf3f-4ca0-48cf-92b7-c532522402d1', 'ec97d17c-495d-422e-8715-05323910f2d0', '3679354b-97fa-482a-ab7f-3f8e43c091f9'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d8e7d991-218b-4f8b-8d27-0765b48499a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d8e7d991-218b-4f8b-8d27-0765b48499a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d8e7d991-218b-4f8b-8d27-0765b48499a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d8e7d991-218b-4f8b-8d27-0765b48499a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d8e7d991-218b-4f8b-8d27-0765b48499a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d8e7d991-218b-4f8b-8d27-0765b48499a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:07 devstack sudo[91908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:12:07 devstack sudo[91908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:07 devstack sudo[91900]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2211aee3-6e67-4615-9c8f-f84de579568f tempest-VolumesTransfersV357Test-1607256338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-044dd766-18cf-4485-b852-613456374610" returned: 0 in 0.593s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2211aee3-6e67-4615-9c8f-f84de579568f tempest-VolumesTransfersV357Test-1607256338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-044dd766-18cf-4485-b852-613456374610 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:07 devstack sudo[91903]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.374s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 8 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:12:07 devstack sudo[91911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-044dd766-18cf-4485-b852-613456374610
Sep 16 16:12:07 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:07 devstack sudo[91908]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d8e7d991-218b-4f8b-8d27-0765b48499a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.285s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-d8e7d991-218b-4f8b-8d27-0765b48499a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:12:07 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-d8e7d991-218b-4f8b-8d27-0765b48499a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Deleted volume successfully.
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d8e7d991-218b-4f8b-8d27-0765b48499a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-925593811 None] Lock "cinder-8a3ce51b-4f20-4701-8147-58ba62050722-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:12:07 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2211aee3-6e67-4615-9c8f-f84de579568f tempest-VolumesTransfersV357Test-1607256338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-044dd766-18cf-4485-b852-613456374610" returned: 0 in 0.311s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2211aee3-6e67-4615-9c8f-f84de579568f tempest-VolumesTransfersV357Test-1607256338 None] Lock "cinder-quobyte-044dd766-18cf-4485-b852-613456374610" released by "delete_volume" :: held 0.950s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-2211aee3-6e67-4615-9c8f-f84de579568f tempest-VolumesTransfersV357Test-1607256338 None] Created reservations ['20b03c36-882c-4b11-b906-bc3c69c68b0c', 'efee4c01-67d1-41e7-a19d-8181c34981fb', '747986c0-e0eb-452f-8775-4a9e5c2d8552', 'f5510452-034f-4fde-8640-52b5aab52ad2'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2211aee3-6e67-4615-9c8f-f84de579568f tempest-VolumesTransfersV357Test-1607256338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2211aee3-6e67-4615-9c8f-f84de579568f tempest-VolumesTransfersV357Test-1607256338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2211aee3-6e67-4615-9c8f-f84de579568f tempest-VolumesTransfersV357Test-1607256338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2211aee3-6e67-4615-9c8f-f84de579568f tempest-VolumesTransfersV357Test-1607256338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2211aee3-6e67-4615-9c8f-f84de579568f tempest-VolumesTransfersV357Test-1607256338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2211aee3-6e67-4615-9c8f-f84de579568f tempest-VolumesTransfersV357Test-1607256338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:08 devstack sudo[91915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:12:08 devstack sudo[91915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:08 devstack sudo[91915]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2211aee3-6e67-4615-9c8f-f84de579568f tempest-VolumesTransfersV357Test-1607256338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.293s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-2211aee3-6e67-4615-9c8f-f84de579568f tempest-VolumesTransfersV357Test-1607256338 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:12:08 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-2211aee3-6e67-4615-9c8f-f84de579568f tempest-VolumesTransfersV357Test-1607256338 None] Deleted volume successfully.
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2211aee3-6e67-4615-9c8f-f84de579568f tempest-VolumesTransfersV357Test-1607256338 None] Lock "cinder-044dd766-18cf-4485-b852-613456374610-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Flow 'volume_create_manager' (01698c56-fe1f-4f3a-a582-1c31e32bf9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71789596-c15f-44e3-819e-6e72b7b9baec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71789596-c15f-44e3-819e-6e72b7b9baec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-900947793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15627e79-cd6d-4f37-bd96-9a94f9001d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f88eddf0e6408aa93b84927abd105b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:09Z,use_quota=True,user_id='fa9f5fef4484425db71b0dd8ed4909e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5637f2bd-68e7-489d-8267-e03413120756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5637f2bd-68e7-489d-8267-e03413120756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b92f78d-7751-4852-90b0-a981fb34d286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b92f78d-7751-4852-90b0-a981fb34d286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15627e79-cd6d-4f37-bd96-9a94f9001d47', 'volume_name': 'volume-15627e79-cd6d-4f37-bd96-9a94f9001d47', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606473a9-8d3c-4320-ab80-bb6f4855f87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606473a9-8d3c-4320-ab80-bb6f4855f87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f0621a-1f58-44f9-bffa-a0a9960cb373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:08 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Volume 15627e79-cd6d-4f37-bd96-9a94f9001d47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15627e79-cd6d-4f37-bd96-9a94f9001d47', 'volume_size': 1}
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-900947793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15627e79-cd6d-4f37-bd96-9a94f9001d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f88eddf0e6408aa93b84927abd105b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:09Z,use_quota=True,user_id='fa9f5fef4484425db71b0dd8ed4909e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Creating volume 15627e79-cd6d-4f37-bd96-9a94f9001d47 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:12:08 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:12:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-15627e79-cd6d-4f37-bd96-9a94f9001d47 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:08 devstack sudo[91918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-15627e79-cd6d-4f37-bd96-9a94f9001d47 1073741824
Sep 16 16:12:08 devstack sudo[91918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:09 devstack sudo[91918]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-15627e79-cd6d-4f37-bd96-9a94f9001d47 1073741824" returned: 0 in 0.597s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-15627e79-cd6d-4f37-bd96-9a94f9001d47 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:09 devstack sudo[91924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-15627e79-cd6d-4f37-bd96-9a94f9001d47
Sep 16 16:12:09 devstack sudo[91924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:09 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:12:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Flow 'volume_create_manager' (1931a619-d35e-4a95-bbb0-0be46ae6400e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:12:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (181ca627-fe7e-489f-8b52-b9702fe654aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (181ca627-fe7e-489f-8b52-b9702fe654aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1861277214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001bc79d-b3e2-438b-abda-42d590f8ed84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08111cd9824d48fbb9e859dc93b4ea1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:10Z,use_quota=True,user_id='107b9507e0f64b7bb34153b40debaf57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6dfd8b-e100-4d08-b5bd-507e48dc7fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6dfd8b-e100-4d08-b5bd-507e48dc7fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff93707c-1972-4260-83bb-ca4fef92df5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:09 devstack cinder-volume[86165]: DEBUG cinder.image.glance [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Creating Keystone auth plugin from conf {{(pid=86165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 16:12:09 devstack sudo[91924]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-15627e79-cd6d-4f37-bd96-9a94f9001d47" returned: 0 in 0.304s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:12:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f0621a-1f58-44f9-bffa-a0a9960cb373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15627e79-cd6d-4f37-bd96-9a94f9001d47', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f0af136-25de-4f57-8d33-98ef4f7726c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:09 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Volume volume-15627e79-cd6d-4f37-bd96-9a94f9001d47 (15627e79-cd6d-4f37-bd96-9a94f9001d47): created successfully
Sep 16 16:12:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f0af136-25de-4f57-8d33-98ef4f7726c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Flow 'volume_create_manager' (01698c56-fe1f-4f3a-a582-1c31e32bf9b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:12:09 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-3bffb3df-b0ca-47ea-8623-53a67f9ffdab tempest-VolumesTransfersV357Test-620793499 None] Created volume successfully.
Sep 16 16:12:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff93707c-1972-4260-83bb-ca4fef92df5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '001bc79d-b3e2-438b-abda-42d590f8ed84', 'volume_name': 'volume-001bc79d-b3e2-438b-abda-42d590f8ed84', 'volume_size': 1, 'image_id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '896515a0bbf44034a5d624f4b911b6d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 2, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f1ed024-e14f-4371-8a39-a1d416ee528e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e4c5a9e50>}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46603d1-fe77-4b4c-aa63-f0e2c9618f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46603d1-fe77-4b4c-aa63-f0e2c9618f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85433ba-07ee-48aa-ab4d-994bd51b7e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:10 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Volume 001bc79d-b3e2-438b-abda-42d590f8ed84: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-001bc79d-b3e2-438b-abda-42d590f8ed84', 'volume_size': 1, 'image_id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '896515a0bbf44034a5d624f4b911b6d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 2, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f1ed024-e14f-4371-8a39-a1d416ee528e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e4c5a9e50>}
Sep 16 16:12:10 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Trying to clone 001bc79d-b3e2-438b-abda-42d590f8ed84 from image 4f1ed024-e14f-4371-8a39-a1d416ee528e at location (None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}]). {{(pid=86165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 16:12:11 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_3j5dsv40devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 16:12:11 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Image download 20.69 MB at 20.69 MB/s
Sep 16 16:12:11 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4445ed4-31dd-488a-8176-970ed89b4f49]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:12:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_3j5dsv40devstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:11 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-388a2baf-5f7f-4351-ae68-145cc7c2d888 tempest-VolumesTransfersV357Test-1607256338 None] Acquiring lock "cinder-15627e79-cd6d-4f37-bd96-9a94f9001d47-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:12:11 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-388a2baf-5f7f-4351-ae68-145cc7c2d888 tempest-VolumesTransfersV357Test-1607256338 None] Lock "cinder-15627e79-cd6d-4f37-bd96-9a94f9001d47-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:12:11 devstack sudo[91949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_3j5dsv40devstack@QuobyteHD
Sep 16 16:12:11 devstack sudo[91949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:11 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-388a2baf-5f7f-4351-ae68-145cc7c2d888 tempest-VolumesTransfersV357Test-1607256338 None] Acquiring lock "cinder-quobyte-15627e79-cd6d-4f37-bd96-9a94f9001d47" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:12:11 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-388a2baf-5f7f-4351-ae68-145cc7c2d888 tempest-VolumesTransfersV357Test-1607256338 None] Lock "cinder-quobyte-15627e79-cd6d-4f37-bd96-9a94f9001d47" acquired by "delete_volume" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:12:11 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7766cb-726c-4768-a8e4-710841cdd5d6]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:12:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-388a2baf-5f7f-4351-ae68-145cc7c2d888 tempest-VolumesTransfersV357Test-1607256338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-15627e79-cd6d-4f37-bd96-9a94f9001d47 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:11 devstack sudo[91951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-15627e79-cd6d-4f37-bd96-9a94f9001d47
Sep 16 16:12:11 devstack sudo[91951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:11 devstack sudo[91949]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_3j5dsv40devstack@QuobyteHD" returned: 0 in 0.437s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:11 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Temporary image 4f1ed024-e14f-4371-8a39-a1d416ee528e is fetched for user 107b9507e0f64b7bb34153b40debaf57. {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 16:12:11 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91b7c86-210c-41ac-ab8c-353b9c830be6]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:12:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_3j5dsv40devstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:11 devstack sudo[91959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_3j5dsv40devstack@QuobyteHD
Sep 16 16:12:11 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:11 devstack sudo[91951]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-388a2baf-5f7f-4351-ae68-145cc7c2d888 tempest-VolumesTransfersV357Test-1607256338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-15627e79-cd6d-4f37-bd96-9a94f9001d47" returned: 0 in 0.481s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-388a2baf-5f7f-4351-ae68-145cc7c2d888 tempest-VolumesTransfersV357Test-1607256338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-15627e79-cd6d-4f37-bd96-9a94f9001d47 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:11 devstack sudo[91967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-15627e79-cd6d-4f37-bd96-9a94f9001d47
Sep 16 16:12:11 devstack sudo[91967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:12 devstack sudo[91967]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:12 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_3j5dsv40devstack@QuobyteHD" returned: 0 in 0.468s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1861277214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001bc79d-b3e2-438b-abda-42d590f8ed84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08111cd9824d48fbb9e859dc93b4ea1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:10Z,use_quota=True,user_id='107b9507e0f64b7bb34153b40debaf57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Creating volume 001bc79d-b3e2-438b-abda-42d590f8ed84 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:12:12 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-001bc79d-b3e2-438b-abda-42d590f8ed84 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-388a2baf-5f7f-4351-ae68-145cc7c2d888 tempest-VolumesTransfersV357Test-1607256338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-15627e79-cd6d-4f37-bd96-9a94f9001d47" returned: 0 in 0.308s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-388a2baf-5f7f-4351-ae68-145cc7c2d888 tempest-VolumesTransfersV357Test-1607256338 None] Lock "cinder-quobyte-15627e79-cd6d-4f37-bd96-9a94f9001d47" released by "delete_volume" :: held 0.855s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:12:12 devstack sudo[91973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-001bc79d-b3e2-438b-abda-42d590f8ed84 1073741824
Sep 16 16:12:12 devstack sudo[91973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-388a2baf-5f7f-4351-ae68-145cc7c2d888 tempest-VolumesTransfersV357Test-1607256338 None] Created reservations ['1fd5d2f0-c672-49f5-896b-514f145796de', 'a5522f31-f410-4451-8f95-bdd7947584d8', '974bb9f2-b902-4e7e-80bf-8fdbcd759e50', '01de726c-de3b-4e65-80fd-8d9b048d5084'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-388a2baf-5f7f-4351-ae68-145cc7c2d888 tempest-VolumesTransfersV357Test-1607256338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-388a2baf-5f7f-4351-ae68-145cc7c2d888 tempest-VolumesTransfersV357Test-1607256338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-388a2baf-5f7f-4351-ae68-145cc7c2d888 tempest-VolumesTransfersV357Test-1607256338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-388a2baf-5f7f-4351-ae68-145cc7c2d888 tempest-VolumesTransfersV357Test-1607256338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-388a2baf-5f7f-4351-ae68-145cc7c2d888 tempest-VolumesTransfersV357Test-1607256338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-388a2baf-5f7f-4351-ae68-145cc7c2d888 tempest-VolumesTransfersV357Test-1607256338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:12 devstack sudo[91975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:12:12 devstack sudo[91975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:12 devstack sudo[91975]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-388a2baf-5f7f-4351-ae68-145cc7c2d888 tempest-VolumesTransfersV357Test-1607256338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.333s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-388a2baf-5f7f-4351-ae68-145cc7c2d888 tempest-VolumesTransfersV357Test-1607256338 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:12:12 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-388a2baf-5f7f-4351-ae68-145cc7c2d888 tempest-VolumesTransfersV357Test-1607256338 None] Deleted volume successfully.
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-388a2baf-5f7f-4351-ae68-145cc7c2d888 tempest-VolumesTransfersV357Test-1607256338 None] Lock "cinder-15627e79-cd6d-4f37-bd96-9a94f9001d47-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:12:12 devstack sudo[91973]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-001bc79d-b3e2-438b-abda-42d590f8ed84 1073741824" returned: 0 in 0.613s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-001bc79d-b3e2-438b-abda-42d590f8ed84 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:12 devstack sudo[91982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-001bc79d-b3e2-438b-abda-42d590f8ed84
Sep 16 16:12:12 devstack sudo[91982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:13 devstack sudo[91982]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-001bc79d-b3e2-438b-abda-42d590f8ed84" returned: 0 in 0.285s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:12:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:13 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Attempting download of 4f1ed024-e14f-4371-8a39-a1d416ee528e ((None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}])) to volume 001bc79d-b3e2-438b-abda-42d590f8ed84. {{(pid=86165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 16:12:13 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[89db3234-709a-4ec6-a5c7-736a9908a80a]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:12:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_l49bq29r {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:13 devstack sudo[91985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_l49bq29r
Sep 16 16:12:13 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:13 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_l49bq29r" returned: 0 in 0.365s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_l49bq29r {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:13 devstack sudo[91989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_l49bq29r
Sep 16 16:12:13 devstack sudo[91989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:13 devstack sudo[91989]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_l49bq29r" returned: 1 in 0.359s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_l49bq29r' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:12:13 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b3cc14-ae93-4732-927f-09701ef57f49]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:12:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_3j5dsv40devstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:14 devstack sudo[91993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_3j5dsv40devstack@QuobyteHD
Sep 16 16:12:14 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:14 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_3j5dsv40devstack@QuobyteHD" returned: 0 in 0.375s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:14 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] 4f1ed024-e14f-4371-8a39-a1d416ee528e was qcow2, converting to qcow2 {{(pid=86165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 16:12:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_3j5dsv40devstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-001bc79d-b3e2-438b-abda-42d590f8ed84 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:14 devstack sudo[91998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_3j5dsv40devstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-001bc79d-b3e2-438b-abda-42d590f8ed84
Sep 16 16:12:14 devstack sudo[91998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:17 devstack sudo[91998]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_3j5dsv40devstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-001bc79d-b3e2-438b-abda-42d590f8ed84" returned: 0 in 2.680s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:17 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_3j5dsv40devstack@QuobyteHD, size 112.00 MB, duration 2.68 sec, destination /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-001bc79d-b3e2-438b-abda-42d590f8ed84 {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:12:17 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Converted 112.00 MB image at 41.78 MB/s
Sep 16 16:12:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-001bc79d-b3e2-438b-abda-42d590f8ed84 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:17 devstack sudo[92008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-001bc79d-b3e2-438b-abda-42d590f8ed84 1G
Sep 16 16:12:17 devstack sudo[92008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:17 devstack sudo[92008]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-001bc79d-b3e2-438b-abda-42d590f8ed84 1G" returned: 0 in 0.439s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:17 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Downloaded image 4f1ed024-e14f-4371-8a39-a1d416ee528e ((None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}])) to volume 001bc79d-b3e2-438b-abda-42d590f8ed84 successfully. {{(pid=86165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 16:12:17 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Temporary image 4f1ed024-e14f-4371-8a39-a1d416ee528e for user 107b9507e0f64b7bb34153b40debaf57 is deleted. {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 16:12:17 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Marking volume 001bc79d-b3e2-438b-abda-42d590f8ed84 as bootable. {{(pid=86165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 16:12:17 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Copying metadata from image 4f1ed024-e14f-4371-8a39-a1d416ee528e to 001bc79d-b3e2-438b-abda-42d590f8ed84. {{(pid=86165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 16:12:17 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Creating volume glance metadata for volume 001bc79d-b3e2-438b-abda-42d590f8ed84 backed by image 4f1ed024-e14f-4371-8a39-a1d416ee528e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 16:12:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85433ba-07ee-48aa-ab4d-994bd51b7e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-001bc79d-b3e2-438b-abda-42d590f8ed84', 'volume_size': 1, 'image_id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '896515a0bbf44034a5d624f4b911b6d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 2, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f1ed024-e14f-4371-8a39-a1d416ee528e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e4c5a9e50>}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec14684-b236-4975-8958-f7bf88193f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:17 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Volume volume-001bc79d-b3e2-438b-abda-42d590f8ed84 (001bc79d-b3e2-438b-abda-42d590f8ed84): created successfully
Sep 16 16:12:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec14684-b236-4975-8958-f7bf88193f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Flow 'volume_create_manager' (1931a619-d35e-4a95-bbb0-0be46ae6400e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:12:17 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-2be4b985-b55d-43cf-82d9-4e4b35444850 tempest-ServerActionsTestOtherA-2007622607 None] Created volume successfully.
Sep 16 16:12:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-b053e08f-1784-4035-8d63-b5683008d0bc req-8ab83662-c7a5-432a-95a2-d4baba2b4e5b tempest-ServerActionsTestOtherA-2007622607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-b053e08f-1784-4035-8d63-b5683008d0bc req-8ab83662-c7a5-432a-95a2-d4baba2b4e5b tempest-ServerActionsTestOtherA-2007622607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-b053e08f-1784-4035-8d63-b5683008d0bc req-8ab83662-c7a5-432a-95a2-d4baba2b4e5b tempest-ServerActionsTestOtherA-2007622607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:23 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-07e9c298-0a95-44b1-bda4-d3a85cc9c4ef tempest-GroupsV314Test-355367001 None] Group tempest-GroupsV314Test-Group-215585129: creating
Sep 16 16:12:23 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-b053e08f-1784-4035-8d63-b5683008d0bc req-8ab83662-c7a5-432a-95a2-d4baba2b4e5b tempest-ServerActionsTestOtherA-2007622607 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-001bc79d-b3e2-438b-abda-42d590f8ed84', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c8c8885-9f98-4088-be63-cf2244ab5994', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:12:23 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-07e9c298-0a95-44b1-bda4-d3a85cc9c4ef tempest-GroupsV314Test-355367001 None] Group tempest-GroupsV314Test-Group-215585129: created successfully
Sep 16 16:12:23 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-07e9c298-0a95-44b1-bda4-d3a85cc9c4ef tempest-GroupsV314Test-355367001 None] Create group completed successfully.
Sep 16 16:12:23 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-b053e08f-1784-4035-8d63-b5683008d0bc req-8ab83662-c7a5-432a-95a2-d4baba2b4e5b tempest-ServerActionsTestOtherA-2007622607 None] attachment_update completed successfully.
Sep 16 16:12:27 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:12:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Flow 'volume_create_manager' (b496ea46-c282-4c63-9dee-489c8fb90387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:12:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e550ae9-ff8b-4b13-adc2-04165ee2b838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e550ae9-ff8b-4b13-adc2-04165ee2b838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-336680642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c6d7d1f9-5dbb-4e12-9c18-d04c6fa6ba2f,host='devstack@QuobyteHD#QuobyteHD',id=bea20f60-64a6-4cce-8bea-1e67ec000150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8d5b28582f1467085bd1c3244670964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:28Z,use_quota=True,user_id='eb1aa45ab9d34f0e82de6fd3ab4ebff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b87bae59-5d77-4f65-80a5-6e5a1efa4886),volume_type_id=b87bae59-5d77-4f65-80a5-6e5a1efa4886)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1d27f5-cff5-40cf-93d9-d4623c387446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1d27f5-cff5-40cf-93d9-d4623c387446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8d4e29-c69f-4036-bb0a-52ae8403a8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8d4e29-c69f-4036-bb0a-52ae8403a8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bea20f60-64a6-4cce-8bea-1e67ec000150', 'volume_name': 'volume-bea20f60-64a6-4cce-8bea-1e67ec000150', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed51882-6339-4918-8e5e-c9a125afd12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed51882-6339-4918-8e5e-c9a125afd12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df466eaf-1629-46f4-94f0-4ca8fafe6a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:27 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Volume bea20f60-64a6-4cce-8bea-1e67ec000150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bea20f60-64a6-4cce-8bea-1e67ec000150', 'volume_size': 1}
Sep 16 16:12:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c6d7d1f9-5dbb-4e12-9c18-d04c6fa6ba2f,created_at=2026-09-16T14:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-336680642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c6d7d1f9-5dbb-4e12-9c18-d04c6fa6ba2f,host='devstack@QuobyteHD#QuobyteHD',id=bea20f60-64a6-4cce-8bea-1e67ec000150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8d5b28582f1467085bd1c3244670964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:28Z,use_quota=True,user_id='eb1aa45ab9d34f0e82de6fd3ab4ebff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b87bae59-5d77-4f65-80a5-6e5a1efa4886),volume_type_id=b87bae59-5d77-4f65-80a5-6e5a1efa4886)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:12:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Creating volume bea20f60-64a6-4cce-8bea-1e67ec000150 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:12:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:12:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:12:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:12:27 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:12:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:27 devstack sudo[92026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150 1073741824
Sep 16 16:12:27 devstack sudo[92026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:28 devstack sudo[92026]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150 1073741824" returned: 0 in 0.575s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:28 devstack sudo[92032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150
Sep 16 16:12:28 devstack sudo[92032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:28 devstack sudo[92032]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150" returned: 0 in 0.401s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:28 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:12:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df466eaf-1629-46f4-94f0-4ca8fafe6a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bea20f60-64a6-4cce-8bea-1e67ec000150', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bb9eaa-5c8b-4a11-adce-275bcc6f3e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:29 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Volume volume-bea20f60-64a6-4cce-8bea-1e67ec000150 (bea20f60-64a6-4cce-8bea-1e67ec000150): created successfully
Sep 16 16:12:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bb9eaa-5c8b-4a11-adce-275bcc6f3e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Flow 'volume_create_manager' (b496ea46-c282-4c63-9dee-489c8fb90387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:12:29 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-122f4162-13ae-4fb0-8fba-1ca272822d7a tempest-GroupsV314Test-355367001 None] Created volume successfully.
Sep 16 16:12:30 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:12:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Flow 'volume_create_manager' (6b8055e0-cc34-43f6-bb78-98ce5c309b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:12:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148528b9-afb1-4f6b-910a-5024aaa3839f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148528b9-afb1-4f6b-910a-5024aaa3839f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-291646413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72117e0-72f0-4df8-ac26-09ce595273bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58b01f9f4236420eabd8bade526d7b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:31Z,use_quota=True,user_id='5477022399ec4bc49229d1521dd8e8b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393618f5-e40f-4700-be44-5367408e5a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393618f5-e40f-4700-be44-5367408e5a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96897bc7-c85f-4b80-99fb-5c376e0b5572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:30 devstack cinder-volume[86165]: DEBUG cinder.image.glance [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Creating Keystone auth plugin from conf {{(pid=86165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 16:12:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96897bc7-c85f-4b80-99fb-5c376e0b5572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c72117e0-72f0-4df8-ac26-09ce595273bb', 'volume_name': 'volume-c72117e0-72f0-4df8-ac26-09ce595273bb', 'volume_size': 1, 'image_id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '896515a0bbf44034a5d624f4b911b6d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 2, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f1ed024-e14f-4371-8a39-a1d416ee528e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e4bf7fad0>}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c564b4-dc38-4979-a7e2-a3103b2529fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c564b4-dc38-4979-a7e2-a3103b2529fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0770e59-ee54-43c7-93a9-96dae7f4abbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:31 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Volume c72117e0-72f0-4df8-ac26-09ce595273bb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c72117e0-72f0-4df8-ac26-09ce595273bb', 'volume_size': 1, 'image_id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '896515a0bbf44034a5d624f4b911b6d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 2, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f1ed024-e14f-4371-8a39-a1d416ee528e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e4bf7fad0>}
Sep 16 16:12:31 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Trying to clone c72117e0-72f0-4df8-ac26-09ce595273bb from image 4f1ed024-e14f-4371-8a39-a1d416ee528e at location (None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}]). {{(pid=86165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 16:12:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:31 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Cloning volume bea20f60-64a6-4cce-8bea-1e67ec000150 to volume 82e5ddd2-29f3-446e-ae9b-b1f660ed7531
Sep 16 16:12:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Creating offline snapshot eed1d6c7-be38-44eb-a148-d28cac8d8457 of volume bea20f60-64a6-4cce-8bea-1e67ec000150 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:12:31 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd354256-a4dd-4c3d-b731-ade1c85540a6]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:12:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:32 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_vjytutiqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 16:12:32 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Image download 20.69 MB at 20.69 MB/s
Sep 16 16:12:32 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1e18af-7b28-4f54-84fd-f6574b4ae6bc]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:12:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_vjytutiqdevstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:32 devstack sudo[92146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150
Sep 16 16:12:32 devstack sudo[92146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:32 devstack sudo[92311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_vjytutiqdevstack@QuobyteHD
Sep 16 16:12:32 devstack sudo[92311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:32 devstack sudo[92146]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150" returned: 0 in 0.864s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:32 devstack sudo[92495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457 1G
Sep 16 16:12:32 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:32 devstack sudo[92311]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_vjytutiqdevstack@QuobyteHD" returned: 0 in 0.869s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:32 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Temporary image 4f1ed024-e14f-4371-8a39-a1d416ee528e is fetched for user 5477022399ec4bc49229d1521dd8e8b9. {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 16:12:33 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a5abbc-8991-46aa-8948-f124c7e213a5]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:12:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_vjytutiqdevstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:33 devstack sudo[92501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_vjytutiqdevstack@QuobyteHD
Sep 16 16:12:33 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:33 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457 1G" returned: 0 in 0.932s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bea20f60-64a6-4cce-8bea-1e67ec000150 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:33 devstack sudo[92510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bea20f60-64a6-4cce-8bea-1e67ec000150 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457
Sep 16 16:12:33 devstack sudo[92510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:33 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_vjytutiqdevstack@QuobyteHD" returned: 0 in 0.628s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:34 devstack sudo[92510]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bea20f60-64a6-4cce-8bea-1e67ec000150 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457" returned: 0 in 0.441s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:34 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457 is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 16:12:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:34 devstack sudo[92518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457
Sep 16 16:12:34 devstack sudo[92518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:34 devstack sudo[92518]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457" returned: 0 in 0.509s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:34 devstack sudo[92521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.info
Sep 16 16:12:34 devstack sudo[92521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:35 devstack sudo[92521]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.info" returned: 0 in 0.392s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:35 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 16:12:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:35 devstack sudo[92524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.info
Sep 16 16:12:35 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:35 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.info" returned: 0 in 0.286s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Acquiring lock "cinder-quobyte-82e5ddd2-29f3-446e-ae9b-b1f660ed7531" by "_copy_volume_from_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:12:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Lock "cinder-quobyte-82e5ddd2-29f3-446e-ae9b-b1f660ed7531" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:12:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] snapshot: eed1d6c7-be38-44eb-a148-d28cac8d8457, volume: 82e5ddd2-29f3-446e-ae9b-b1f660ed7531,  {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 16:12:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:12:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:12:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:35 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33df773-0c31-44cf-ac51-43f9c56d761c]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:12:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:35 devstack sudo[92527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457
Sep 16 16:12:35 devstack sudo[92527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:35 devstack sudo[92527]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457" returned: 0 in 0.427s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bea20f60-64a6-4cce-8bea-1e67ec000150(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:12:35 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[299f8fce-bbb6-4dc2-8441-13be03b33239]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:12:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:36 devstack sudo[92533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150
Sep 16 16:12:36 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:36 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150" returned: 0 in 0.658s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] will copy from snapshot at /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150 {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 16:12:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Creating direct copy from snapshot {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 16:12:36 devstack cinder-volume[86165]: DEBUG cinder.utils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Path /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e5ddd2-29f3-446e-ae9b-b1f660ed7531 not found in is_blk_device check {{(pid=86165) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 16:12:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e5ddd2-29f3-446e-ae9b-b1f660ed7531 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:36 devstack sudo[92539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e5ddd2-29f3-446e-ae9b-b1f660ed7531
Sep 16 16:12:36 devstack sudo[92539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:40 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=122,cinder:INSERT=36,cinder:UPDATE=132,cinder:DELETE=12 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:12:48 devstack sudo[92539]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e5ddd2-29f3-446e-ae9b-b1f660ed7531" returned: 0 in 12.002s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:48 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Image conversion details: src /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150, size 1024.00 MB, duration 12.00 sec, destination /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e5ddd2-29f3-446e-ae9b-b1f660ed7531 {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:12:48 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Converted 1024.00 MB image at 85.31 MB/s
Sep 16 16:12:48 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e5ddd2-29f3-446e-ae9b-b1f660ed7531 is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 16:12:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e5ddd2-29f3-446e-ae9b-b1f660ed7531 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:48 devstack sudo[92571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e5ddd2-29f3-446e-ae9b-b1f660ed7531
Sep 16 16:12:48 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:48 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e5ddd2-29f3-446e-ae9b-b1f660ed7531" returned: 0 in 0.423s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Lock "cinder-quobyte-82e5ddd2-29f3-446e-ae9b-b1f660ed7531" released by "_copy_volume_from_snapshot" :: held 13.641s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=117,cinder:INSERT=40,cinder:UPDATE=130,cinder:DELETE=7 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Acquiring lock "cinder-quobyte-eed1d6c7-be38-44eb-a148-d28cac8d8457" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Lock "cinder-quobyte-eed1d6c7-be38-44eb-a148-d28cac8d8457" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Deleting offline snapshot eed1d6c7-be38-44eb-a148-d28cac8d8457 of volume bea20f60-64a6-4cce-8bea-1e67ec000150 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] snapshot_file for this snap is: volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0371ca30-b2bd-4d4b-872f-9fbd92e0cb34]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Flow 'volume_create_manager' (2a746192-ea65-4274-82a5-fc0a46e8f611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8977b188-ec9c-4b81-a8b4-8ce1cb21e574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8977b188-ec9c-4b81-a8b4-8ce1cb21e574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-840880599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf145e64-7221-4e48-bd3a-d4d46b1ebe8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780c4400bb514e33af8d7e9ab1fb15b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:49Z,use_quota=True,user_id='e1052067a07c44298e8d8ad293881a4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdef680a-a6fe-4f5d-8634-16c77748cb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdef680a-a6fe-4f5d-8634-16c77748cb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879f257f-75dc-40da-b974-197dd5ae32a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879f257f-75dc-40da-b974-197dd5ae32a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf145e64-7221-4e48-bd3a-d4d46b1ebe8c', 'volume_name': 'volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb88e42b-20a5-47fc-968f-31c20bc71786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb88e42b-20a5-47fc-968f-31c20bc71786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e30a69c-c135-4ebd-82e2-7b56f94479ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:49 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Volume cf145e64-7221-4e48-bd3a-d4d46b1ebe8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c', 'volume_size': 1}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:49 devstack sudo[92575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457
Sep 16 16:12:49 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:49 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457" returned: 0 in 0.535s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bea20f60-64a6-4cce-8bea-1e67ec000150(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd814c8-b1a8-4571-81b2-a670a44dac16]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:12:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:49 devstack sudo[92580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150
Sep 16 16:12:49 devstack sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:50 devstack sudo[92580]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150" returned: 0 in 0.638s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:50 devstack sudo[92587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457
Sep 16 16:12:50 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:50 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457" returned: 0 in 0.422s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:50 devstack sudo[92598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457
Sep 16 16:12:50 devstack sudo[92598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:51 devstack sudo[92598]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150.eed1d6c7-be38-44eb-a148-d28cac8d8457" returned: 0 in 0.268s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Lock "cinder-quobyte-eed1d6c7-be38-44eb-a148-d28cac8d8457" released by "_delete_snapshot" :: held 2.014s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.524s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.433s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-291646413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72117e0-72f0-4df8-ac26-09ce595273bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58b01f9f4236420eabd8bade526d7b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:31Z,use_quota=True,user_id='5477022399ec4bc49229d1521dd8e8b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Creating volume c72117e0-72f0-4df8-ac26-09ce595273bb {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:12:51 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c72117e0-72f0-4df8-ac26-09ce595273bb 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:51 devstack sudo[92601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c72117e0-72f0-4df8-ac26-09ce595273bb 1073741824
Sep 16 16:12:51 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:51 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-5d54ed50-3531-48f0-be3a-384f7620676d tempest-GroupsV314Test-355367001 None] Create group from source-group-c6d7d1f9-5dbb-4e12-9c18-d04c6fa6ba2f completed successfully.
Sep 16 16:12:51 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c72117e0-72f0-4df8-ac26-09ce595273bb 1073741824" returned: 0 in 0.512s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c72117e0-72f0-4df8-ac26-09ce595273bb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:51 devstack sudo[92631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c72117e0-72f0-4df8-ac26-09ce595273bb
Sep 16 16:12:51 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:51 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c72117e0-72f0-4df8-ac26-09ce595273bb" returned: 0 in 0.254s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.650s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-840880599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf145e64-7221-4e48-bd3a-d4d46b1ebe8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780c4400bb514e33af8d7e9ab1fb15b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:49Z,use_quota=True,user_id='e1052067a07c44298e8d8ad293881a4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Creating volume cf145e64-7221-4e48-bd3a-d4d46b1ebe8c {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:12:51 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:12:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:51 devstack sudo[92635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c 1073741824
Sep 16 16:12:52 devstack sudo[92635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:52 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Attempting download of 4f1ed024-e14f-4371-8a39-a1d416ee528e ((None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}])) to volume c72117e0-72f0-4df8-ac26-09ce595273bb. {{(pid=86165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 16:12:52 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0be7f91-92dc-4185-aa94-07dcf3f86f29]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:12:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_7mck8no0 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:52 devstack sudo[92639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_7mck8no0
Sep 16 16:12:52 devstack sudo[92639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:52 devstack sudo[92639]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_7mck8no0" returned: 0 in 0.596s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_7mck8no0 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:52 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-6d9cf216-9393-40ed-befa-5171cb31228d req-161e7e29-6c98-48a1-ba00-c028d8aeaa0a tempest-ServerActionsTestOtherA-2007622607 None] Terminate volume connection completed successfully.
Sep 16 16:12:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-6d9cf216-9393-40ed-befa-5171cb31228d req-161e7e29-6c98-48a1-ba00-c028d8aeaa0a tempest-ServerActionsTestOtherA-2007622607 None] Deleting attachment 2c8c8885-9f98-4088-be63-cf2244ab5994. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:12:52 devstack sudo[92635]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c 1073741824" returned: 0 in 0.912s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:52 devstack sudo[92666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_7mck8no0
Sep 16 16:12:52 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:53 devstack sudo[92668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c
Sep 16 16:12:53 devstack sudo[92668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1322994f-5f8e-46ad-8326-ca602099d4a6 tempest-GroupsV314Test-355367001 None] Acquiring lock "cinder-quobyte-82e5ddd2-29f3-446e-ae9b-b1f660ed7531" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:12:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1322994f-5f8e-46ad-8326-ca602099d4a6 tempest-GroupsV314Test-355367001 None] Lock "cinder-quobyte-82e5ddd2-29f3-446e-ae9b-b1f660ed7531" acquired by "delete_volume" :: waited 0.048s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:12:53 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2a3d6d-2438-4b49-8608-056324e636a5]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:12:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1322994f-5f8e-46ad-8326-ca602099d4a6 tempest-GroupsV314Test-355367001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e5ddd2-29f3-446e-ae9b-b1f660ed7531 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:53 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_7mck8no0" returned: 1 in 0.603s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_7mck8no0' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:12:53 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9a8338-1573-465c-84fa-7dde599d92c6]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:12:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_vjytutiqdevstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:53 devstack sudo[92668]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c" returned: 0 in 0.344s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:12:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e30a69c-c135-4ebd-82e2-7b56f94479ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:53 devstack sudo[92670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e5ddd2-29f3-446e-ae9b-b1f660ed7531
Sep 16 16:12:53 devstack sudo[92670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a11af80-3815-4ff6-9808-34efd7db82b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:53 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Volume volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c (cf145e64-7221-4e48-bd3a-d4d46b1ebe8c): created successfully
Sep 16 16:12:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a11af80-3815-4ff6-9808-34efd7db82b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Flow 'volume_create_manager' (2a746192-ea65-4274-82a5-fc0a46e8f611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:12:53 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-1a518263-ed17-4301-b6f9-9d431d77bcfe tempest-VolumesActionsTest-302202208 None] Created volume successfully.
Sep 16 16:12:53 devstack sudo[92674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_vjytutiqdevstack@QuobyteHD
Sep 16 16:12:53 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:53 devstack sudo[92670]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1322994f-5f8e-46ad-8326-ca602099d4a6 tempest-GroupsV314Test-355367001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e5ddd2-29f3-446e-ae9b-b1f660ed7531" returned: 0 in 0.585s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1322994f-5f8e-46ad-8326-ca602099d4a6 tempest-GroupsV314Test-355367001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e5ddd2-29f3-446e-ae9b-b1f660ed7531 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:53 devstack sudo[92685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e5ddd2-29f3-446e-ae9b-b1f660ed7531
Sep 16 16:12:53 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:53 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_vjytutiqdevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:53 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] 4f1ed024-e14f-4371-8a39-a1d416ee528e was qcow2, converting to qcow2 {{(pid=86165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 16:12:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_vjytutiqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c72117e0-72f0-4df8-ac26-09ce595273bb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:53 devstack sudo[92687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_vjytutiqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c72117e0-72f0-4df8-ac26-09ce595273bb
Sep 16 16:12:53 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:53 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1322994f-5f8e-46ad-8326-ca602099d4a6 tempest-GroupsV314Test-355367001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e5ddd2-29f3-446e-ae9b-b1f660ed7531" returned: 0 in 0.268s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1322994f-5f8e-46ad-8326-ca602099d4a6 tempest-GroupsV314Test-355367001 None] Lock "cinder-quobyte-82e5ddd2-29f3-446e-ae9b-b1f660ed7531" released by "delete_volume" :: held 0.920s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:12:54 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-1322994f-5f8e-46ad-8326-ca602099d4a6 tempest-GroupsV314Test-355367001 None] Created reservations ['3c2c0761-388c-4b27-81be-d4adea03aaff'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:12:54 devstack cinder-volume[86165]: WARNING cinder.quota [None req-1322994f-5f8e-46ad-8326-ca602099d4a6 tempest-GroupsV314Test-355367001 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1963639376 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1963639376, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:12:54 devstack cinder-volume[86165]: WARNING cinder.quota [None req-1322994f-5f8e-46ad-8326-ca602099d4a6 tempest-GroupsV314Test-355367001 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1963639376 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1963639376, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:12:54 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-1322994f-5f8e-46ad-8326-ca602099d4a6 tempest-GroupsV314Test-355367001 None] Created reservations ['43f7115b-5196-49a3-9aae-b49730d669a9', '1715cb38-a65f-49bc-895c-82a1969721f6', '3e8d8812-e30f-40cb-96af-b99876c5a0a3', '13de2a45-33bc-4ddd-967e-034b7931b01b'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:12:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1322994f-5f8e-46ad-8326-ca602099d4a6 tempest-GroupsV314Test-355367001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1322994f-5f8e-46ad-8326-ca602099d4a6 tempest-GroupsV314Test-355367001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1322994f-5f8e-46ad-8326-ca602099d4a6 tempest-GroupsV314Test-355367001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:12:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1322994f-5f8e-46ad-8326-ca602099d4a6 tempest-GroupsV314Test-355367001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:12:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1322994f-5f8e-46ad-8326-ca602099d4a6 tempest-GroupsV314Test-355367001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1322994f-5f8e-46ad-8326-ca602099d4a6 tempest-GroupsV314Test-355367001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:54 devstack sudo[92698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:12:54 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:54 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1322994f-5f8e-46ad-8326-ca602099d4a6 tempest-GroupsV314Test-355367001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.416s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:54 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-1322994f-5f8e-46ad-8326-ca602099d4a6 tempest-GroupsV314Test-355367001 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:12:54 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-1322994f-5f8e-46ad-8326-ca602099d4a6 tempest-GroupsV314Test-355367001 None] Delete group completed successfully.
Sep 16 16:12:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-6d9cf216-9393-40ed-befa-5171cb31228d req-ad531393-adf2-45a2-90cc-e6317e9c0eff tempest-ServerActionsTestOtherA-2007622607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-6d9cf216-9393-40ed-befa-5171cb31228d req-ad531393-adf2-45a2-90cc-e6317e9c0eff tempest-ServerActionsTestOtherA-2007622607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2e4f1e11-bdb9-4a60-9d67-80a8416e903e tempest-GroupsV314Test-355367001 None] Acquiring lock "cinder-quobyte-bea20f60-64a6-4cce-8bea-1e67ec000150" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:12:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-6d9cf216-9393-40ed-befa-5171cb31228d req-ad531393-adf2-45a2-90cc-e6317e9c0eff tempest-ServerActionsTestOtherA-2007622607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2e4f1e11-bdb9-4a60-9d67-80a8416e903e tempest-GroupsV314Test-355367001 None] Lock "cinder-quobyte-bea20f60-64a6-4cce-8bea-1e67ec000150" acquired by "delete_volume" :: waited 0.030s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:12:54 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[24899ea2-da11-480c-953b-523a812bfe1b]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:12:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2e4f1e11-bdb9-4a60-9d67-80a8416e903e tempest-GroupsV314Test-355367001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-6d9cf216-9393-40ed-befa-5171cb31228d req-ad531393-adf2-45a2-90cc-e6317e9c0eff tempest-ServerActionsTestOtherA-2007622607 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-001bc79d-b3e2-438b-abda-42d590f8ed84', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c832bf10-c769-428f-988b-10c3d1577a95', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:12:55 devstack sudo[92709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150
Sep 16 16:12:55 devstack sudo[92709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:55 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-6d9cf216-9393-40ed-befa-5171cb31228d req-ad531393-adf2-45a2-90cc-e6317e9c0eff tempest-ServerActionsTestOtherA-2007622607 None] attachment_update completed successfully.
Sep 16 16:12:55 devstack sudo[92709]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2e4f1e11-bdb9-4a60-9d67-80a8416e903e tempest-GroupsV314Test-355367001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150" returned: 0 in 0.546s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2e4f1e11-bdb9-4a60-9d67-80a8416e903e tempest-GroupsV314Test-355367001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:55 devstack sudo[92749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150
Sep 16 16:12:55 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:56 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2e4f1e11-bdb9-4a60-9d67-80a8416e903e tempest-GroupsV314Test-355367001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bea20f60-64a6-4cce-8bea-1e67ec000150" returned: 0 in 0.606s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:56 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2e4f1e11-bdb9-4a60-9d67-80a8416e903e tempest-GroupsV314Test-355367001 None] Lock "cinder-quobyte-bea20f60-64a6-4cce-8bea-1e67ec000150" released by "delete_volume" :: held 1.293s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:12:56 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-2e4f1e11-bdb9-4a60-9d67-80a8416e903e tempest-GroupsV314Test-355367001 None] Created reservations ['e9599141-6122-4582-8ba9-f6ff35fb59e9'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:12:56 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-2e4f1e11-bdb9-4a60-9d67-80a8416e903e tempest-GroupsV314Test-355367001 None] Created reservations ['b333fcae-cbca-4508-a1cf-a258c9944b93', 'f9201bef-639f-4d93-9772-6256f137f315', 'cad01c78-541f-4913-b0e3-30a9775edded', '4bfbee81-4117-4b50-8685-a58387e4bc8f'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:12:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2e4f1e11-bdb9-4a60-9d67-80a8416e903e tempest-GroupsV314Test-355367001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:12:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2e4f1e11-bdb9-4a60-9d67-80a8416e903e tempest-GroupsV314Test-355367001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:12:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2e4f1e11-bdb9-4a60-9d67-80a8416e903e tempest-GroupsV314Test-355367001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:12:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2e4f1e11-bdb9-4a60-9d67-80a8416e903e tempest-GroupsV314Test-355367001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:12:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2e4f1e11-bdb9-4a60-9d67-80a8416e903e tempest-GroupsV314Test-355367001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:12:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2e4f1e11-bdb9-4a60-9d67-80a8416e903e tempest-GroupsV314Test-355367001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:56 devstack sudo[93195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:12:56 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:56 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_vjytutiqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c72117e0-72f0-4df8-ac26-09ce595273bb" returned: 0 in 3.022s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:56 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_vjytutiqdevstack@QuobyteHD, size 112.00 MB, duration 3.02 sec, destination /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c72117e0-72f0-4df8-ac26-09ce595273bb {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:12:56 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Converted 112.00 MB image at 37.03 MB/s
Sep 16 16:12:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c72117e0-72f0-4df8-ac26-09ce595273bb 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:12:56 devstack sudo[93201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c72117e0-72f0-4df8-ac26-09ce595273bb 1G
Sep 16 16:12:56 devstack sudo[93201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:12:57 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2e4f1e11-bdb9-4a60-9d67-80a8416e903e tempest-GroupsV314Test-355367001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.446s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:57 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-2e4f1e11-bdb9-4a60-9d67-80a8416e903e tempest-GroupsV314Test-355367001 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:12:57 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-2e4f1e11-bdb9-4a60-9d67-80a8416e903e tempest-GroupsV314Test-355367001 None] Delete group completed successfully.
Sep 16 16:12:57 devstack sudo[93201]: pam_unix(sudo:session): session closed for user root
Sep 16 16:12:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c72117e0-72f0-4df8-ac26-09ce595273bb 1G" returned: 0 in 0.595s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:12:57 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Downloaded image 4f1ed024-e14f-4371-8a39-a1d416ee528e ((None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}])) to volume c72117e0-72f0-4df8-ac26-09ce595273bb successfully. {{(pid=86165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 16:12:57 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Temporary image 4f1ed024-e14f-4371-8a39-a1d416ee528e for user 5477022399ec4bc49229d1521dd8e8b9 is deleted. {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 16:12:57 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Marking volume c72117e0-72f0-4df8-ac26-09ce595273bb as bootable. {{(pid=86165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 16:12:57 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Copying metadata from image 4f1ed024-e14f-4371-8a39-a1d416ee528e to c72117e0-72f0-4df8-ac26-09ce595273bb. {{(pid=86165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 16:12:57 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Creating volume glance metadata for volume c72117e0-72f0-4df8-ac26-09ce595273bb backed by image 4f1ed024-e14f-4371-8a39-a1d416ee528e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 16:12:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0770e59-ee54-43c7-93a9-96dae7f4abbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c72117e0-72f0-4df8-ac26-09ce595273bb', 'volume_size': 1, 'image_id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '896515a0bbf44034a5d624f4b911b6d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 2, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f1ed024-e14f-4371-8a39-a1d416ee528e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e4bf7fad0>}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1eaba23-aa50-4cae-b405-52e2c8fd2a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:12:57 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Volume volume-c72117e0-72f0-4df8-ac26-09ce595273bb (c72117e0-72f0-4df8-ac26-09ce595273bb): created successfully
Sep 16 16:12:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1eaba23-aa50-4cae-b405-52e2c8fd2a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:12:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Flow 'volume_create_manager' (6b8055e0-cc34-43f6-bb78-98ce5c309b7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:12:57 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-fa927bfc-34e1-4c33-8ff7-fe1153532697 tempest-VolumesImageMetadata-1752546796 None] Created volume successfully.
Sep 16 16:13:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7ba3defd-4181-4e48-a985-20a1ed51c3ea tempest-VolumesImageMetadata-1752546796 None] Acquiring lock "cinder-c72117e0-72f0-4df8-ac26-09ce595273bb-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:13:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7ba3defd-4181-4e48-a985-20a1ed51c3ea tempest-VolumesImageMetadata-1752546796 None] Lock "cinder-c72117e0-72f0-4df8-ac26-09ce595273bb-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:13:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7ba3defd-4181-4e48-a985-20a1ed51c3ea tempest-VolumesImageMetadata-1752546796 None] Acquiring lock "cinder-quobyte-c72117e0-72f0-4df8-ac26-09ce595273bb" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:13:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7ba3defd-4181-4e48-a985-20a1ed51c3ea tempest-VolumesImageMetadata-1752546796 None] Lock "cinder-quobyte-c72117e0-72f0-4df8-ac26-09ce595273bb" acquired by "delete_volume" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:13:00 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0627135-02dd-4c4e-85ab-13ed4bc86622]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:13:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7ba3defd-4181-4e48-a985-20a1ed51c3ea tempest-VolumesImageMetadata-1752546796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c72117e0-72f0-4df8-ac26-09ce595273bb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:00 devstack sudo[93236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c72117e0-72f0-4df8-ac26-09ce595273bb
Sep 16 16:13:00 devstack sudo[93236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:00 devstack sudo[93236]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7ba3defd-4181-4e48-a985-20a1ed51c3ea tempest-VolumesImageMetadata-1752546796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c72117e0-72f0-4df8-ac26-09ce595273bb" returned: 0 in 0.696s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7ba3defd-4181-4e48-a985-20a1ed51c3ea tempest-VolumesImageMetadata-1752546796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c72117e0-72f0-4df8-ac26-09ce595273bb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:01 devstack sudo[93241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c72117e0-72f0-4df8-ac26-09ce595273bb
Sep 16 16:13:01 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:01 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7ba3defd-4181-4e48-a985-20a1ed51c3ea tempest-VolumesImageMetadata-1752546796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c72117e0-72f0-4df8-ac26-09ce595273bb" returned: 0 in 0.483s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:01 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7ba3defd-4181-4e48-a985-20a1ed51c3ea tempest-VolumesImageMetadata-1752546796 None] Lock "cinder-quobyte-c72117e0-72f0-4df8-ac26-09ce595273bb" released by "delete_volume" :: held 1.284s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:13:01 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-7ba3defd-4181-4e48-a985-20a1ed51c3ea tempest-VolumesImageMetadata-1752546796 None] Created reservations ['349083f3-8b8d-47d6-9678-01041df07861', '6605ff59-d44a-4584-ac94-56796d5f7450', '8d4476d7-a2e8-4355-86d8-0bd817b3d74a', '071016f1-2d47-40e4-873b-0978918d5b6d'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:13:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7ba3defd-4181-4e48-a985-20a1ed51c3ea tempest-VolumesImageMetadata-1752546796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:13:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7ba3defd-4181-4e48-a985-20a1ed51c3ea tempest-VolumesImageMetadata-1752546796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:13:01 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7ba3defd-4181-4e48-a985-20a1ed51c3ea tempest-VolumesImageMetadata-1752546796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:13:01 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7ba3defd-4181-4e48-a985-20a1ed51c3ea tempest-VolumesImageMetadata-1752546796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:13:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7ba3defd-4181-4e48-a985-20a1ed51c3ea tempest-VolumesImageMetadata-1752546796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:13:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7ba3defd-4181-4e48-a985-20a1ed51c3ea tempest-VolumesImageMetadata-1752546796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:01 devstack sudo[93244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:13:01 devstack sudo[93244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:02 devstack sudo[93244]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7ba3defd-4181-4e48-a985-20a1ed51c3ea tempest-VolumesImageMetadata-1752546796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.398s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:02 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-7ba3defd-4181-4e48-a985-20a1ed51c3ea tempest-VolumesImageMetadata-1752546796 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:13:02 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-7ba3defd-4181-4e48-a985-20a1ed51c3ea tempest-VolumesImageMetadata-1752546796 None] Deleted volume successfully.
Sep 16 16:13:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7ba3defd-4181-4e48-a985-20a1ed51c3ea tempest-VolumesImageMetadata-1752546796 None] Lock "cinder-c72117e0-72f0-4df8-ac26-09ce595273bb-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:13:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:13:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:13:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:13:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:13:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:13:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:13:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:07 devstack sudo[93318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:13:07 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:07 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.255s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:13:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:13:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 28 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:13:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>, <Thread(tpool_thread_0, started daemon 135438770624192)>, <Thread(tpool_thread_1, started daemon 135438762231488)>, <Thread(tpool_thread_2, started daemon 135438753838784)>, <Thread(tpool_thread_3, started daemon 135438745446080)>, <Thread(tpool_thread_4, started daemon 135438737053376)>, <Thread(tpool_thread_5, started daemon 135438728660672)>, <Thread(tpool_thread_6, started daemon 135438720267968)>, <Thread(tpool_thread_7, started daemon 135438711875264)>, <Thread(tpool_thread_8, started daemon 135438703466176)>, <Thread(tpool_thread_9, started daemon 135438695057088)>, <Thread(tpool_thread_10, started daemon 135438686648000)>, <Thread(tpool_thread_11, started daemon 135438678238912)>, <Thread(tpool_thread_12, started daemon 135438669829824)>, <Thread(tpool_thread_13, started daemon 135438661420736)>, <Thread(tpool_thread_14, started daemon 135438653011648)>, <Thread(tpool_thread_15, started daemon 135438644602560)>, <Thread(tpool_thread_16, started daemon 135438636193472)>, <Thread(tpool_thread_17, started daemon 135438627784384)>, <Thread(tpool_thread_18, started daemon 135438619375296)>, <Thread(tpool_thread_19, started daemon 135438610966208)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:13:11 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=41,cinder:SELECT=39,cinder:DELETE=2,cinder:INSERT=16 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:13:12 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=41,cinder:UPDATE=40,cinder:INSERT=12,cinder:DELETE=1 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:13:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c4bd0653-92d4-4f40-980d-0868f6b99774 tempest-VolumesActionsTest-302202208 None] Acquiring lock "cinder-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c" by "attach_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:13:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c4bd0653-92d4-4f40-980d-0868f6b99774 tempest-VolumesActionsTest-302202208 None] Lock "cinder-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c" acquired by "attach_volume" :: waited 0.029s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:13:14 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c4bd0653-92d4-4f40-980d-0868f6b99774 tempest-VolumesActionsTest-302202208 None] Attaching volume cf145e64-7221-4e48-bd3a-d4d46b1ebe8c to instance ed5c6b3f-c1fd-4568-8010-afbad01a3699 at mountpoint /dev/vdb on host None.
Sep 16 16:13:14 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c4bd0653-92d4-4f40-980d-0868f6b99774 tempest-VolumesActionsTest-302202208 None] Attach volume completed successfully.
Sep 16 16:13:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c4bd0653-92d4-4f40-980d-0868f6b99774 tempest-VolumesActionsTest-302202208 None] Lock "cinder-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c" released by "attach_volume" :: held 0.144s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:13:15 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-35ee5f75-f261-48cf-9bcd-582ac1401e90 tempest-GroupsV320Test-257045327 None] Group tempest-GroupsV320Test-Group-650232503: creating
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6782db6d-f48e-4d13-abe8-b0168b2327b6 tempest-VolumesActionsTest-302202208 None] Acquiring lock "cinder-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c-detach_volume" by "detach_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:13:15 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-35ee5f75-f261-48cf-9bcd-582ac1401e90 tempest-GroupsV320Test-257045327 None] Group tempest-GroupsV320Test-Group-650232503: created successfully
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6782db6d-f48e-4d13-abe8-b0168b2327b6 tempest-VolumesActionsTest-302202208 None] Lock "cinder-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:13:15 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-6782db6d-f48e-4d13-abe8-b0168b2327b6 tempest-VolumesActionsTest-302202208 None] Detaching volume cf145e64-7221-4e48-bd3a-d4d46b1ebe8c from instance ed5c6b3f-c1fd-4568-8010-afbad01a3699.
Sep 16 16:13:15 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-35ee5f75-f261-48cf-9bcd-582ac1401e90 tempest-GroupsV320Test-257045327 None] Create group completed successfully.
Sep 16 16:13:15 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-6782db6d-f48e-4d13-abe8-b0168b2327b6 tempest-VolumesActionsTest-302202208 None] Detach volume completed successfully.
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6782db6d-f48e-4d13-abe8-b0168b2327b6 tempest-VolumesActionsTest-302202208 None] Lock "cinder-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c-detach_volume" released by "detach_volume" :: held 0.101s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Flow 'volume_create_manager' (2cfdc95b-a0b8-44e8-a8bf-4c9dcd7c908c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20502b0a-c7ff-4dac-b799-cbe7fb513718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20502b0a-c7ff-4dac-b799-cbe7fb513718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1140543893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945a6b0e-fef8-46b5-9f74-23a6bc5b23a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93e7b363ff24e0e99dab5f1b252593f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:13:16Z,use_quota=True,user_id='1f3137ac92854e918cf4a6f1054e50d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28de6c66-0d2e-4329-8579-c38b51971ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28de6c66-0d2e-4329-8579-c38b51971ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dc901bf-9c2c-47fc-80a8-99cb52b609c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dc901bf-9c2c-47fc-80a8-99cb52b609c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '945a6b0e-fef8-46b5-9f74-23a6bc5b23a6', 'volume_name': 'volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1aff4e-bebf-41ce-b71c-537fa5a6d2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1aff4e-bebf-41ce-b71c-537fa5a6d2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be6816b-92df-4dc0-8c64-ab30b6d9b368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:13:15 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Volume 945a6b0e-fef8-46b5-9f74-23a6bc5b23a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6', 'volume_size': 1}
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1140543893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945a6b0e-fef8-46b5-9f74-23a6bc5b23a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93e7b363ff24e0e99dab5f1b252593f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:13:16Z,use_quota=True,user_id='1f3137ac92854e918cf4a6f1054e50d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Creating volume 945a6b0e-fef8-46b5-9f74-23a6bc5b23a6 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:13:15 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:13:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:15 devstack sudo[93440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6 1073741824
Sep 16 16:13:15 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:16 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6 1073741824" returned: 0 in 0.817s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:16 devstack sudo[93467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6
Sep 16 16:13:16 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:17 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-787b1ffa-f2a1-4212-9086-9ad5767463c5 tempest-GroupsV320Test-257045327 None] Created reservations ['6bcd4335-449c-4985-a32d-3167bbbb37ad'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:13:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-787b1ffa-f2a1-4212-9086-9ad5767463c5 tempest-GroupsV320Test-257045327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:13:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-787b1ffa-f2a1-4212-9086-9ad5767463c5 tempest-GroupsV320Test-257045327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:13:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-787b1ffa-f2a1-4212-9086-9ad5767463c5 tempest-GroupsV320Test-257045327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:13:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-787b1ffa-f2a1-4212-9086-9ad5767463c5 tempest-GroupsV320Test-257045327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:13:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-787b1ffa-f2a1-4212-9086-9ad5767463c5 tempest-GroupsV320Test-257045327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:13:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-787b1ffa-f2a1-4212-9086-9ad5767463c5 tempest-GroupsV320Test-257045327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:17 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6" returned: 0 in 0.435s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:13:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:13:17 devstack sudo[93471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:13:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be6816b-92df-4dc0-8c64-ab30b6d9b368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:13:17 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28558fac-4457-43f0-941b-6782d131f8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:13:17 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Volume volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6 (945a6b0e-fef8-46b5-9f74-23a6bc5b23a6): created successfully
Sep 16 16:13:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28558fac-4457-43f0-941b-6782d131f8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:13:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Flow 'volume_create_manager' (2cfdc95b-a0b8-44e8-a8bf-4c9dcd7c908c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:13:17 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-0b5af9d8-1728-47fa-a9b3-441a7392d5d6 tempest-SnapshotMetadataTestJSON-1236284794 None] Created volume successfully.
Sep 16 16:13:17 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-787b1ffa-f2a1-4212-9086-9ad5767463c5 tempest-GroupsV320Test-257045327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.403s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:17 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-787b1ffa-f2a1-4212-9086-9ad5767463c5 tempest-GroupsV320Test-257045327 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:13:17 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-787b1ffa-f2a1-4212-9086-9ad5767463c5 tempest-GroupsV320Test-257045327 None] Delete group completed successfully.
Sep 16 16:13:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b547ff9a-4303-4e0c-8807-aac64ed0113c tempest-SnapshotMetadataTestJSON-1236284794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:13:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b547ff9a-4303-4e0c-8807-aac64ed0113c tempest-SnapshotMetadataTestJSON-1236284794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:13:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-b547ff9a-4303-4e0c-8807-aac64ed0113c tempest-SnapshotMetadataTestJSON-1236284794 None] Creating offline snapshot ec392139-2d26-41f6-9e32-c18dc564739b of volume 945a6b0e-fef8-46b5-9f74-23a6bc5b23a6 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:13:18 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cee276-5bad-4303-bc29-9aaece688c1d]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:13:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b547ff9a-4303-4e0c-8807-aac64ed0113c tempest-SnapshotMetadataTestJSON-1236284794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:18 devstack sudo[93475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6
Sep 16 16:13:18 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:18 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b547ff9a-4303-4e0c-8807-aac64ed0113c tempest-SnapshotMetadataTestJSON-1236284794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6" returned: 0 in 0.444s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b547ff9a-4303-4e0c-8807-aac64ed0113c tempest-SnapshotMetadataTestJSON-1236284794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.ec392139-2d26-41f6-9e32-c18dc564739b 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:18 devstack sudo[93480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.ec392139-2d26-41f6-9e32-c18dc564739b 1G
Sep 16 16:13:18 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:19 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b547ff9a-4303-4e0c-8807-aac64ed0113c tempest-SnapshotMetadataTestJSON-1236284794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.ec392139-2d26-41f6-9e32-c18dc564739b 1G" returned: 0 in 0.572s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b547ff9a-4303-4e0c-8807-aac64ed0113c tempest-SnapshotMetadataTestJSON-1236284794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.ec392139-2d26-41f6-9e32-c18dc564739b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:19 devstack sudo[93487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.ec392139-2d26-41f6-9e32-c18dc564739b
Sep 16 16:13:19 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:19 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b547ff9a-4303-4e0c-8807-aac64ed0113c tempest-SnapshotMetadataTestJSON-1236284794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.ec392139-2d26-41f6-9e32-c18dc564739b" returned: 0 in 0.358s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:19 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-b547ff9a-4303-4e0c-8807-aac64ed0113c tempest-SnapshotMetadataTestJSON-1236284794 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.ec392139-2d26-41f6-9e32-c18dc564739b is being set with open permissions: ugo+rw
Sep 16 16:13:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b547ff9a-4303-4e0c-8807-aac64ed0113c tempest-SnapshotMetadataTestJSON-1236284794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.ec392139-2d26-41f6-9e32-c18dc564739b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:19 devstack sudo[93493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.ec392139-2d26-41f6-9e32-c18dc564739b
Sep 16 16:13:19 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:19 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b547ff9a-4303-4e0c-8807-aac64ed0113c tempest-SnapshotMetadataTestJSON-1236284794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.ec392139-2d26-41f6-9e32-c18dc564739b" returned: 0 in 0.326s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b547ff9a-4303-4e0c-8807-aac64ed0113c tempest-SnapshotMetadataTestJSON-1236284794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:19 devstack sudo[93499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.info
Sep 16 16:13:19 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:20 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b547ff9a-4303-4e0c-8807-aac64ed0113c tempest-SnapshotMetadataTestJSON-1236284794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.info" returned: 0 in 0.351s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:20 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-b547ff9a-4303-4e0c-8807-aac64ed0113c tempest-SnapshotMetadataTestJSON-1236284794 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.info is being set with open permissions: ugo+rw
Sep 16 16:13:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b547ff9a-4303-4e0c-8807-aac64ed0113c tempest-SnapshotMetadataTestJSON-1236284794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:20 devstack sudo[93503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.info
Sep 16 16:13:20 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:20 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b547ff9a-4303-4e0c-8807-aac64ed0113c tempest-SnapshotMetadataTestJSON-1236284794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.info" returned: 0 in 0.288s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b547ff9a-4303-4e0c-8807-aac64ed0113c tempest-SnapshotMetadataTestJSON-1236284794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.474s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:13:20 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b547ff9a-4303-4e0c-8807-aac64ed0113c tempest-SnapshotMetadataTestJSON-1236284794 None] Create snapshot completed successfully
Sep 16 16:13:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f70fb86a-0c90-4ebe-ac72-5dfc35cb7052 tempest-SnapshotMetadataTestJSON-1236284794 None] Acquiring lock "cinder-ec392139-2d26-41f6-9e32-c18dc564739b-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:13:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f70fb86a-0c90-4ebe-ac72-5dfc35cb7052 tempest-SnapshotMetadataTestJSON-1236284794 None] Lock "cinder-ec392139-2d26-41f6-9e32-c18dc564739b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:13:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f70fb86a-0c90-4ebe-ac72-5dfc35cb7052 tempest-SnapshotMetadataTestJSON-1236284794 None] Acquiring lock "cinder-quobyte-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:13:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f70fb86a-0c90-4ebe-ac72-5dfc35cb7052 tempest-SnapshotMetadataTestJSON-1236284794 None] Lock "cinder-quobyte-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:13:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f70fb86a-0c90-4ebe-ac72-5dfc35cb7052 tempest-SnapshotMetadataTestJSON-1236284794 None] Acquiring lock "cinder-quobyte-ec392139-2d26-41f6-9e32-c18dc564739b" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:13:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f70fb86a-0c90-4ebe-ac72-5dfc35cb7052 tempest-SnapshotMetadataTestJSON-1236284794 None] Lock "cinder-quobyte-ec392139-2d26-41f6-9e32-c18dc564739b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:13:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-f70fb86a-0c90-4ebe-ac72-5dfc35cb7052 tempest-SnapshotMetadataTestJSON-1236284794 None] Deleting offline snapshot ec392139-2d26-41f6-9e32-c18dc564739b of volume 945a6b0e-fef8-46b5-9f74-23a6bc5b23a6 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:13:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-f70fb86a-0c90-4ebe-ac72-5dfc35cb7052 tempest-SnapshotMetadataTestJSON-1236284794 None] snapshot_file for this snap is: volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.ec392139-2d26-41f6-9e32-c18dc564739b {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:13:22 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1aae0e9-e96e-4639-87fb-01e438078634]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:13:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f70fb86a-0c90-4ebe-ac72-5dfc35cb7052 tempest-SnapshotMetadataTestJSON-1236284794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.ec392139-2d26-41f6-9e32-c18dc564739b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:22 devstack sudo[93523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.ec392139-2d26-41f6-9e32-c18dc564739b
Sep 16 16:13:22 devstack sudo[93523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:23 devstack sudo[93523]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f70fb86a-0c90-4ebe-ac72-5dfc35cb7052 tempest-SnapshotMetadataTestJSON-1236284794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.ec392139-2d26-41f6-9e32-c18dc564739b" returned: 0 in 0.444s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-f70fb86a-0c90-4ebe-ac72-5dfc35cb7052 tempest-SnapshotMetadataTestJSON-1236284794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:13:23 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f7ae77-aaf4-4fa3-9ff0-fc19ca158e6f]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:13:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f70fb86a-0c90-4ebe-ac72-5dfc35cb7052 tempest-SnapshotMetadataTestJSON-1236284794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:23 devstack sudo[93528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6
Sep 16 16:13:23 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:23 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f70fb86a-0c90-4ebe-ac72-5dfc35cb7052 tempest-SnapshotMetadataTestJSON-1236284794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6" returned: 0 in 0.454s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f70fb86a-0c90-4ebe-ac72-5dfc35cb7052 tempest-SnapshotMetadataTestJSON-1236284794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.ec392139-2d26-41f6-9e32-c18dc564739b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:23 devstack sudo[93534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.ec392139-2d26-41f6-9e32-c18dc564739b
Sep 16 16:13:23 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:24 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f70fb86a-0c90-4ebe-ac72-5dfc35cb7052 tempest-SnapshotMetadataTestJSON-1236284794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.ec392139-2d26-41f6-9e32-c18dc564739b" returned: 0 in 0.429s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f70fb86a-0c90-4ebe-ac72-5dfc35cb7052 tempest-SnapshotMetadataTestJSON-1236284794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.ec392139-2d26-41f6-9e32-c18dc564739b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:24 devstack sudo[93539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.ec392139-2d26-41f6-9e32-c18dc564739b
Sep 16 16:13:24 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:24 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f70fb86a-0c90-4ebe-ac72-5dfc35cb7052 tempest-SnapshotMetadataTestJSON-1236284794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6.ec392139-2d26-41f6-9e32-c18dc564739b" returned: 0 in 0.444s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f70fb86a-0c90-4ebe-ac72-5dfc35cb7052 tempest-SnapshotMetadataTestJSON-1236284794 None] Lock "cinder-quobyte-ec392139-2d26-41f6-9e32-c18dc564739b" released by "_delete_snapshot" :: held 1.943s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:13:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f70fb86a-0c90-4ebe-ac72-5dfc35cb7052 tempest-SnapshotMetadataTestJSON-1236284794 None] Lock "cinder-quobyte-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6" released by "delete_snapshot" :: held 1.986s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:13:24 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-f70fb86a-0c90-4ebe-ac72-5dfc35cb7052 tempest-SnapshotMetadataTestJSON-1236284794 None] Created reservations ['5407683a-bef7-491f-be66-ff1263704d9d', 'b6db344b-d203-4f3c-8e11-8d4330be4f3b', 'da8db720-1c49-4893-b8f3-b16ebfbd7765', '20e9f67b-7b81-427a-bffc-5ab5b8acd84d'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:13:24 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-f70fb86a-0c90-4ebe-ac72-5dfc35cb7052 tempest-SnapshotMetadataTestJSON-1236284794 None] Delete snapshot completed successfully.
Sep 16 16:13:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f70fb86a-0c90-4ebe-ac72-5dfc35cb7052 tempest-SnapshotMetadataTestJSON-1236284794 None] Lock "cinder-ec392139-2d26-41f6-9e32-c18dc564739b-delete_snapshot" released by "delete_snapshot" :: held 2.396s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:13:25 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ad525ded-b6eb-4737-ad90-5a6f939eecea tempest-SnapshotMetadataTestJSON-1236284794 None] Acquiring lock "cinder-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:13:25 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ad525ded-b6eb-4737-ad90-5a6f939eecea tempest-SnapshotMetadataTestJSON-1236284794 None] Lock "cinder-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:13:25 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ad525ded-b6eb-4737-ad90-5a6f939eecea tempest-SnapshotMetadataTestJSON-1236284794 None] Acquiring lock "cinder-quobyte-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:13:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ad525ded-b6eb-4737-ad90-5a6f939eecea tempest-SnapshotMetadataTestJSON-1236284794 None] Lock "cinder-quobyte-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6" acquired by "delete_volume" :: waited 0.024s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:13:26 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd49c2b-fcad-468d-99e9-7f3c4e7e0ca7]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:13:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ad525ded-b6eb-4737-ad90-5a6f939eecea tempest-SnapshotMetadataTestJSON-1236284794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:26 devstack sudo[93610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6
Sep 16 16:13:26 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:26 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ad525ded-b6eb-4737-ad90-5a6f939eecea tempest-SnapshotMetadataTestJSON-1236284794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6" returned: 0 in 0.677s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ad525ded-b6eb-4737-ad90-5a6f939eecea tempest-SnapshotMetadataTestJSON-1236284794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:26 devstack sudo[93615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6
Sep 16 16:13:26 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:27 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ad525ded-b6eb-4737-ad90-5a6f939eecea tempest-SnapshotMetadataTestJSON-1236284794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6" returned: 0 in 0.321s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:27 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ad525ded-b6eb-4737-ad90-5a6f939eecea tempest-SnapshotMetadataTestJSON-1236284794 None] Lock "cinder-quobyte-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6" released by "delete_volume" :: held 1.124s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:13:27 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-ad525ded-b6eb-4737-ad90-5a6f939eecea tempest-SnapshotMetadataTestJSON-1236284794 None] Created reservations ['ef604ca2-70de-4a96-839b-7d1e3a4c0c60', '224839f5-630d-4098-968c-8e8b6c344ce5', 'b798188c-d001-4f87-9d21-d8e6b06ad282', 'bfe7b1f9-472a-4f34-8c0a-d8f1635f3dfd'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:13:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ad525ded-b6eb-4737-ad90-5a6f939eecea tempest-SnapshotMetadataTestJSON-1236284794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:13:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ad525ded-b6eb-4737-ad90-5a6f939eecea tempest-SnapshotMetadataTestJSON-1236284794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:13:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ad525ded-b6eb-4737-ad90-5a6f939eecea tempest-SnapshotMetadataTestJSON-1236284794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:13:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ad525ded-b6eb-4737-ad90-5a6f939eecea tempest-SnapshotMetadataTestJSON-1236284794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:13:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ad525ded-b6eb-4737-ad90-5a6f939eecea tempest-SnapshotMetadataTestJSON-1236284794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:13:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ad525ded-b6eb-4737-ad90-5a6f939eecea tempest-SnapshotMetadataTestJSON-1236284794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:27 devstack sudo[93618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:13:27 devstack sudo[93618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:27 devstack sudo[93618]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ad525ded-b6eb-4737-ad90-5a6f939eecea tempest-SnapshotMetadataTestJSON-1236284794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.323s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:27 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-ad525ded-b6eb-4737-ad90-5a6f939eecea tempest-SnapshotMetadataTestJSON-1236284794 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:13:27 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-ad525ded-b6eb-4737-ad90-5a6f939eecea tempest-SnapshotMetadataTestJSON-1236284794 None] Deleted volume successfully.
Sep 16 16:13:27 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ad525ded-b6eb-4737-ad90-5a6f939eecea tempest-SnapshotMetadataTestJSON-1236284794 None] Lock "cinder-945a6b0e-fef8-46b5-9f74-23a6bc5b23a6-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:13:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b37e428d-9a31-4b5c-b7ee-e003028c19dd tempest-VolumesActionsTest-302202208 None] Acquiring lock "cinder-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c" by "attach_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:13:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b37e428d-9a31-4b5c-b7ee-e003028c19dd tempest-VolumesActionsTest-302202208 None] Lock "cinder-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c" acquired by "attach_volume" :: waited 0.036s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:13:28 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b37e428d-9a31-4b5c-b7ee-e003028c19dd tempest-VolumesActionsTest-302202208 None] Attaching volume cf145e64-7221-4e48-bd3a-d4d46b1ebe8c to instance d848b8d9-ef51-4ede-833d-dd1b1e23a3a4 at mountpoint /dev/vdb on host None.
Sep 16 16:13:28 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b37e428d-9a31-4b5c-b7ee-e003028c19dd tempest-VolumesActionsTest-302202208 None] Attach volume completed successfully.
Sep 16 16:13:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b37e428d-9a31-4b5c-b7ee-e003028c19dd tempest-VolumesActionsTest-302202208 None] Lock "cinder-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c" released by "attach_volume" :: held 0.165s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:13:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-47a688c1-8727-4082-90b6-40b62e93dd09 tempest-VolumesActionsTest-302202208 None] Acquiring lock "cinder-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c-detach_volume" by "detach_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:13:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-47a688c1-8727-4082-90b6-40b62e93dd09 tempest-VolumesActionsTest-302202208 None] Lock "cinder-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:13:29 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-47a688c1-8727-4082-90b6-40b62e93dd09 tempest-VolumesActionsTest-302202208 None] Detaching volume cf145e64-7221-4e48-bd3a-d4d46b1ebe8c from instance d848b8d9-ef51-4ede-833d-dd1b1e23a3a4.
Sep 16 16:13:29 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-47a688c1-8727-4082-90b6-40b62e93dd09 tempest-VolumesActionsTest-302202208 None] Detach volume completed successfully.
Sep 16 16:13:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-47a688c1-8727-4082-90b6-40b62e93dd09 tempest-VolumesActionsTest-302202208 None] Lock "cinder-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c-detach_volume" released by "detach_volume" :: held 0.087s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:13:35 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-58ddacb3-914d-4421-b569-1021e1127b13 req-a68f1f33-e3be-45a3-96fb-14e941fbe015 tempest-ServerActionsTestOtherA-2007622607 None] Terminate volume connection completed successfully.
Sep 16 16:13:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-58ddacb3-914d-4421-b569-1021e1127b13 req-a68f1f33-e3be-45a3-96fb-14e941fbe015 tempest-ServerActionsTestOtherA-2007622607 None] Deleting attachment c832bf10-c769-428f-988b-10c3d1577a95. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:13:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-58ddacb3-914d-4421-b569-1021e1127b13 req-d873778a-8528-449c-acfa-660380e51796 tempest-ServerActionsTestOtherA-2007622607 None] Acquiring lock "cinder-001bc79d-b3e2-438b-abda-42d590f8ed84-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:13:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-58ddacb3-914d-4421-b569-1021e1127b13 req-d873778a-8528-449c-acfa-660380e51796 tempest-ServerActionsTestOtherA-2007622607 None] Lock "cinder-001bc79d-b3e2-438b-abda-42d590f8ed84-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:13:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-58ddacb3-914d-4421-b569-1021e1127b13 req-d873778a-8528-449c-acfa-660380e51796 tempest-ServerActionsTestOtherA-2007622607 None] Acquiring lock "cinder-quobyte-001bc79d-b3e2-438b-abda-42d590f8ed84" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:13:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3479edad-3362-42a7-8c3b-4c0942e0b0a1 tempest-VolumesActionsTest-302202208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:13:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3479edad-3362-42a7-8c3b-4c0942e0b0a1 tempest-VolumesActionsTest-302202208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:13:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-58ddacb3-914d-4421-b569-1021e1127b13 req-d873778a-8528-449c-acfa-660380e51796 tempest-ServerActionsTestOtherA-2007622607 None] Lock "cinder-quobyte-001bc79d-b3e2-438b-abda-42d590f8ed84" acquired by "delete_volume" :: waited 0.043s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:13:35 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b51f550-bf48-49eb-abe4-e1c0ea577ea5]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:13:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3479edad-3362-42a7-8c3b-4c0942e0b0a1 tempest-VolumesActionsTest-302202208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:35 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c83c7d2-9a79-482f-a3c2-cb720b7b77be]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:13:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-58ddacb3-914d-4421-b569-1021e1127b13 req-d873778a-8528-449c-acfa-660380e51796 tempest-ServerActionsTestOtherA-2007622607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-001bc79d-b3e2-438b-abda-42d590f8ed84 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:36 devstack sudo[93676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c
Sep 16 16:13:36 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:36 devstack sudo[93677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-001bc79d-b3e2-438b-abda-42d590f8ed84
Sep 16 16:13:36 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:36 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-58ddacb3-914d-4421-b569-1021e1127b13 req-d873778a-8528-449c-acfa-660380e51796 tempest-ServerActionsTestOtherA-2007622607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-001bc79d-b3e2-438b-abda-42d590f8ed84" returned: 0 in 0.515s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-58ddacb3-914d-4421-b569-1021e1127b13 req-d873778a-8528-449c-acfa-660380e51796 tempest-ServerActionsTestOtherA-2007622607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-001bc79d-b3e2-438b-abda-42d590f8ed84 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:36 devstack sudo[93686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-001bc79d-b3e2-438b-abda-42d590f8ed84
Sep 16 16:13:36 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:36 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3479edad-3362-42a7-8c3b-4c0942e0b0a1 tempest-VolumesActionsTest-302202208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c" returned: 0 in 0.622s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:36 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[107f625a-f880-42c1-ba68-5108f65e18d6]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:13:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3479edad-3362-42a7-8c3b-4c0942e0b0a1 tempest-VolumesActionsTest-302202208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:36 devstack sudo[93688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c
Sep 16 16:13:36 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:36 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-58ddacb3-914d-4421-b569-1021e1127b13 req-d873778a-8528-449c-acfa-660380e51796 tempest-ServerActionsTestOtherA-2007622607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-001bc79d-b3e2-438b-abda-42d590f8ed84" returned: 0 in 0.366s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:36 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-58ddacb3-914d-4421-b569-1021e1127b13 req-d873778a-8528-449c-acfa-660380e51796 tempest-ServerActionsTestOtherA-2007622607 None] Lock "cinder-quobyte-001bc79d-b3e2-438b-abda-42d590f8ed84" released by "delete_volume" :: held 0.993s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:13:36 devstack cinder-volume[86165]: DEBUG cinder.quota [req-58ddacb3-914d-4421-b569-1021e1127b13 req-d873778a-8528-449c-acfa-660380e51796 tempest-ServerActionsTestOtherA-2007622607 None] Created reservations ['0eb490c0-4dd2-44ae-bb27-c737297a6024', 'c0521562-a122-4d61-9813-f5615caccee7', '37ef2d19-4708-46a2-b1b0-c6cbe5bc30de', '1c72f743-86ff-4506-97a9-ee01b9dc1b41'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:13:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-58ddacb3-914d-4421-b569-1021e1127b13 req-d873778a-8528-449c-acfa-660380e51796 tempest-ServerActionsTestOtherA-2007622607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:13:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-58ddacb3-914d-4421-b569-1021e1127b13 req-d873778a-8528-449c-acfa-660380e51796 tempest-ServerActionsTestOtherA-2007622607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:13:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [req-58ddacb3-914d-4421-b569-1021e1127b13 req-d873778a-8528-449c-acfa-660380e51796 tempest-ServerActionsTestOtherA-2007622607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:13:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [req-58ddacb3-914d-4421-b569-1021e1127b13 req-d873778a-8528-449c-acfa-660380e51796 tempest-ServerActionsTestOtherA-2007622607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:13:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-58ddacb3-914d-4421-b569-1021e1127b13 req-d873778a-8528-449c-acfa-660380e51796 tempest-ServerActionsTestOtherA-2007622607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:13:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-58ddacb3-914d-4421-b569-1021e1127b13 req-d873778a-8528-449c-acfa-660380e51796 tempest-ServerActionsTestOtherA-2007622607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:37 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:37 devstack sudo[93694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:13:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3479edad-3362-42a7-8c3b-4c0942e0b0a1 tempest-VolumesActionsTest-302202208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c" returned: 0 in 0.551s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:37 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3479edad-3362-42a7-8c3b-4c0942e0b0a1 tempest-VolumesActionsTest-302202208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c /opt/stack/data/cinder/conversion/cf145e64-7221-4e48-bd3a-d4d46b1ebe8c.temp_image.7bc12104-c58c-4e43-aa37-783f88b0ef8f44j07mnj.img {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:37 devstack sudo[93697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c /opt/stack/data/cinder/conversion/cf145e64-7221-4e48-bd3a-d4d46b1ebe8c.temp_image.7bc12104-c58c-4e43-aa37-783f88b0ef8f44j07mnj.img
Sep 16 16:13:37 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-579e0de5-2ab4-4cdb-9d90-2b6fb2027a91 tempest-ServerActionsTestOtherA-2007622607 None] Acquiring lock "cinder-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:13:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-579e0de5-2ab4-4cdb-9d90-2b6fb2027a91 tempest-ServerActionsTestOtherA-2007622607 None] Lock "cinder-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:13:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-579e0de5-2ab4-4cdb-9d90-2b6fb2027a91 tempest-ServerActionsTestOtherA-2007622607 None] Acquiring lock "cinder-quobyte-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:13:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-579e0de5-2ab4-4cdb-9d90-2b6fb2027a91 tempest-ServerActionsTestOtherA-2007622607 None] Lock "cinder-quobyte-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5" acquired by "delete_volume" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:13:37 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-58ddacb3-914d-4421-b569-1021e1127b13 req-d873778a-8528-449c-acfa-660380e51796 tempest-ServerActionsTestOtherA-2007622607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.448s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:37 devstack cinder-volume[86165]: DEBUG cinder.manager [req-58ddacb3-914d-4421-b569-1021e1127b13 req-d873778a-8528-449c-acfa-660380e51796 tempest-ServerActionsTestOtherA-2007622607 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:13:37 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-58ddacb3-914d-4421-b569-1021e1127b13 req-d873778a-8528-449c-acfa-660380e51796 tempest-ServerActionsTestOtherA-2007622607 None] Deleted volume successfully.
Sep 16 16:13:37 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d701794-fea2-4748-adb4-68f989ed6c17]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:13:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-579e0de5-2ab4-4cdb-9d90-2b6fb2027a91 tempest-ServerActionsTestOtherA-2007622607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-58ddacb3-914d-4421-b569-1021e1127b13 req-d873778a-8528-449c-acfa-660380e51796 tempest-ServerActionsTestOtherA-2007622607 None] Lock "cinder-001bc79d-b3e2-438b-abda-42d590f8ed84-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:13:37 devstack sudo[93703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5
Sep 16 16:13:37 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:38 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-579e0de5-2ab4-4cdb-9d90-2b6fb2027a91 tempest-ServerActionsTestOtherA-2007622607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5" returned: 0 in 0.944s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-579e0de5-2ab4-4cdb-9d90-2b6fb2027a91 tempest-ServerActionsTestOtherA-2007622607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:38 devstack sudo[93716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5
Sep 16 16:13:38 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:39 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-579e0de5-2ab4-4cdb-9d90-2b6fb2027a91 tempest-ServerActionsTestOtherA-2007622607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5" returned: 0 in 0.682s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-579e0de5-2ab4-4cdb-9d90-2b6fb2027a91 tempest-ServerActionsTestOtherA-2007622607 None] Lock "cinder-quobyte-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5" released by "delete_volume" :: held 1.702s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:13:39 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-579e0de5-2ab4-4cdb-9d90-2b6fb2027a91 tempest-ServerActionsTestOtherA-2007622607 None] Created reservations ['b24b1855-d9d2-4ea2-880b-24437bf14704', 'ba5202a0-d629-43fc-a9c6-c227011e3a88', '6296f815-3c92-4553-9448-af4c0a5bb65b', '49d5964d-790c-42c3-a0e6-d5db46712268'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:13:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-579e0de5-2ab4-4cdb-9d90-2b6fb2027a91 tempest-ServerActionsTestOtherA-2007622607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:13:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-579e0de5-2ab4-4cdb-9d90-2b6fb2027a91 tempest-ServerActionsTestOtherA-2007622607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:13:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-579e0de5-2ab4-4cdb-9d90-2b6fb2027a91 tempest-ServerActionsTestOtherA-2007622607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:13:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-579e0de5-2ab4-4cdb-9d90-2b6fb2027a91 tempest-ServerActionsTestOtherA-2007622607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:13:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-579e0de5-2ab4-4cdb-9d90-2b6fb2027a91 tempest-ServerActionsTestOtherA-2007622607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:13:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-579e0de5-2ab4-4cdb-9d90-2b6fb2027a91 tempest-ServerActionsTestOtherA-2007622607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:39 devstack sudo[93721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:13:39 devstack sudo[93721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:39 devstack sudo[93721]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-579e0de5-2ab4-4cdb-9d90-2b6fb2027a91 tempest-ServerActionsTestOtherA-2007622607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.552s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:39 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-579e0de5-2ab4-4cdb-9d90-2b6fb2027a91 tempest-ServerActionsTestOtherA-2007622607 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:13:39 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-579e0de5-2ab4-4cdb-9d90-2b6fb2027a91 tempest-ServerActionsTestOtherA-2007622607 None] Deleted volume successfully.
Sep 16 16:13:40 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-579e0de5-2ab4-4cdb-9d90-2b6fb2027a91 tempest-ServerActionsTestOtherA-2007622607 None] Lock "cinder-eb18160b-72eb-4dcc-bf52-fd8b9a6ecbd5-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:13:44 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:13:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Flow 'volume_create_manager' (d64c20db-12d5-45e8-93a2-cbc11f54a478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:13:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (703f53cd-2110-465c-9577-dcf5fd1de878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:13:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (703f53cd-2110-465c-9577-dcf5fd1de878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1284922219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b2d622-a7e5-44ac-b40e-54914bf9b245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8501ed8c76a44a68950d66507c4d7fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:13:45Z,use_quota=True,user_id='5aee8b0dc3b04b66819d389bae0d5256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:13:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9a2ef3-0702-4bf6-956f-a2fc9e72ddef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:13:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9a2ef3-0702-4bf6-956f-a2fc9e72ddef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:13:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0569c3-e6de-4e8c-997d-19931262c075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:13:44 devstack cinder-volume[86165]: DEBUG cinder.image.glance [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Creating Keystone auth plugin from conf {{(pid=86165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 16:13:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0569c3-e6de-4e8c-997d-19931262c075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '33b2d622-a7e5-44ac-b40e-54914bf9b245', 'volume_name': 'volume-33b2d622-a7e5-44ac-b40e-54914bf9b245', 'volume_size': 1, 'image_id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '896515a0bbf44034a5d624f4b911b6d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 2, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f1ed024-e14f-4371-8a39-a1d416ee528e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e41b5c290>}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:13:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62781c15-78d1-449c-8b5c-b686591a4e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:13:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62781c15-78d1-449c-8b5c-b686591a4e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:13:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be76a60-b1a0-4c8f-93b2-333fef8cc206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:13:45 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Volume 33b2d622-a7e5-44ac-b40e-54914bf9b245: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-33b2d622-a7e5-44ac-b40e-54914bf9b245', 'volume_size': 1, 'image_id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '896515a0bbf44034a5d624f4b911b6d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 2, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f1ed024-e14f-4371-8a39-a1d416ee528e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e41b5c290>}
Sep 16 16:13:45 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Trying to clone 33b2d622-a7e5-44ac-b40e-54914bf9b245 from image 4f1ed024-e14f-4371-8a39-a1d416ee528e at location (None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}]). {{(pid=86165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 16:13:46 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_tmw8g63_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 16:13:46 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Image download 20.69 MB at 20.69 MB/s
Sep 16 16:13:46 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9f5409-2a0b-480b-ae98-a112e7513856]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:13:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_tmw8g63_devstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:46 devstack sudo[93756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_tmw8g63_devstack@QuobyteHD
Sep 16 16:13:46 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:47 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3479edad-3362-42a7-8c3b-4c0942e0b0a1 tempest-VolumesActionsTest-302202208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c /opt/stack/data/cinder/conversion/cf145e64-7221-4e48-bd3a-d4d46b1ebe8c.temp_image.7bc12104-c58c-4e43-aa37-783f88b0ef8f44j07mnj.img" returned: 0 in 10.086s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:47 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb9a5a9-10ad-48f9-a01c-5ed1cee758fe]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:13:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3479edad-3362-42a7-8c3b-4c0942e0b0a1 tempest-VolumesActionsTest-302202208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:47 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:47 devstack sudo[93758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c
Sep 16 16:13:47 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_tmw8g63_devstack@QuobyteHD" returned: 0 in 0.588s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:47 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Temporary image 4f1ed024-e14f-4371-8a39-a1d416ee528e is fetched for user 5aee8b0dc3b04b66819d389bae0d5256. {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 16:13:47 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f4bf19-f90b-45d2-8640-29f77baeb27e]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:13:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_tmw8g63_devstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:13:47 devstack sudo[93763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_tmw8g63_devstack@QuobyteHD
Sep 16 16:13:47 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:13:47 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3479edad-3362-42a7-8c3b-4c0942e0b0a1 tempest-VolumesActionsTest-302202208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c" returned: 0 in 0.569s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:47 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-3479edad-3362-42a7-8c3b-4c0942e0b0a1 tempest-VolumesActionsTest-302202208 None] Image conversion details: src /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c, size 1024.00 MB, duration 10.09 sec, destination /opt/stack/data/cinder/conversion/cf145e64-7221-4e48-bd3a-d4d46b1ebe8c.temp_image.7bc12104-c58c-4e43-aa37-783f88b0ef8f44j07mnj.img {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:13:47 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-3479edad-3362-42a7-8c3b-4c0942e0b0a1 tempest-VolumesActionsTest-302202208 None] Converted 1024.00 MB image at 101.51 MB/s
Sep 16 16:13:47 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root
Sep 16 16:13:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_tmw8g63_devstack@QuobyteHD" returned: 0 in 0.353s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:13:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:13:47 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-3479edad-3362-42a7-8c3b-4c0942e0b0a1 tempest-VolumesActionsTest-302202208 None] 7bc12104-c58c-4e43-aa37-783f88b0ef8f was raw, no need to convert to raw {{(pid=86165) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 16 16:13:57 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=41,cinder:UPDATE=46,cinder:DELETE=3,cinder:INSERT=11 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:13:57 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=59,cinder:INSERT=13,cinder:UPDATE=42,cinder:DELETE=2 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:13:58 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:13:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Flow 'volume_create_manager' (7a17e78e-8116-43d6-85a1-038538c47911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:13:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbacd0d-589f-4975-9be3-f03484f40094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:13:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbacd0d-589f-4975-9be3-f03484f40094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-13435360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff951ae7-a245-46c0-98da-75c51db77e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b99e5635414ed6943bf9c08f840fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:13:59Z,use_quota=True,user_id='23d8bdf865504ba2855135639d216edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:13:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e312613-ad3a-4c89-bba9-196c7cc78ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:13:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e312613-ad3a-4c89-bba9-196c7cc78ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:13:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e0d00b-aebc-4412-bb96-e1538acd515c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:13:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e0d00b-aebc-4412-bb96-e1538acd515c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff951ae7-a245-46c0-98da-75c51db77e90', 'volume_name': 'volume-ff951ae7-a245-46c0-98da-75c51db77e90', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:13:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd016878-b9aa-4148-8c5c-269e84044b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:13:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd016878-b9aa-4148-8c5c-269e84044b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:13:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e091720b-17fb-4067-b1e2-ab3debc78a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:13:58 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Volume ff951ae7-a245-46c0-98da-75c51db77e90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff951ae7-a245-46c0-98da-75c51db77e90', 'volume_size': 1}
Sep 16 16:13:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:14:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:14:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:14:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:07 devstack sudo[93815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:14:07 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:07 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.354s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:14:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:14:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 28 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:14:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>, <Thread(tpool_thread_0, started daemon 135438770624192)>, <Thread(tpool_thread_1, started daemon 135438762231488)>, <Thread(tpool_thread_2, started daemon 135438753838784)>, <Thread(tpool_thread_3, started daemon 135438745446080)>, <Thread(tpool_thread_4, started daemon 135438737053376)>, <Thread(tpool_thread_5, started daemon 135438728660672)>, <Thread(tpool_thread_6, started daemon 135438720267968)>, <Thread(tpool_thread_7, started daemon 135438711875264)>, <Thread(tpool_thread_8, started daemon 135438703466176)>, <Thread(tpool_thread_9, started daemon 135438695057088)>, <Thread(tpool_thread_10, started daemon 135438686648000)>, <Thread(tpool_thread_11, started daemon 135438678238912)>, <Thread(tpool_thread_12, started daemon 135438669829824)>, <Thread(tpool_thread_13, started daemon 135438661420736)>, <Thread(tpool_thread_14, started daemon 135438653011648)>, <Thread(tpool_thread_15, started daemon 135438644602560)>, <Thread(tpool_thread_16, started daemon 135438636193472)>, <Thread(tpool_thread_17, started daemon 135438627784384)>, <Thread(tpool_thread_18, started daemon 135438619375296)>, <Thread(tpool_thread_19, started daemon 135438610966208)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:14:08 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=1 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:14:08 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=2 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:14:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3479edad-3362-42a7-8c3b-4c0942e0b0a1 tempest-VolumesActionsTest-302202208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.043s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3479edad-3362-42a7-8c3b-4c0942e0b0a1 tempest-VolumesActionsTest-302202208 None] Uploaded volume to glance image-id: 7bc12104-c58c-4e43-aa37-783f88b0ef8f. {{(pid=86165) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 16 16:14:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.078s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1284922219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b2d622-a7e5-44ac-b40e-54914bf9b245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8501ed8c76a44a68950d66507c4d7fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:13:45Z,use_quota=True,user_id='5aee8b0dc3b04b66819d389bae0d5256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:14:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Creating volume 33b2d622-a7e5-44ac-b40e-54914bf9b245 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:14:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:14:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:14:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:14:10 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:14:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:10 devstack sudo[93823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245 1073741824
Sep 16 16:14:10 devstack sudo[93823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:10 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-3479edad-3362-42a7-8c3b-4c0942e0b0a1 tempest-VolumesActionsTest-302202208 None] Copy volume to image completed successfully.
Sep 16 16:14:11 devstack sudo[93823]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245 1073741824" returned: 0 in 0.499s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:11 devstack sudo[93839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245
Sep 16 16:14:11 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:11 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245" returned: 0 in 0.349s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:14:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.858s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-13435360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff951ae7-a245-46c0-98da-75c51db77e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1b99e5635414ed6943bf9c08f840fa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:13:59Z,use_quota=True,user_id='23d8bdf865504ba2855135639d216edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:14:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Creating volume ff951ae7-a245-46c0-98da-75c51db77e90 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:14:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:14:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:14:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:14:11 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:14:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ff951ae7-a245-46c0-98da-75c51db77e90 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:11 devstack sudo[93847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ff951ae7-a245-46c0-98da-75c51db77e90 1073741824
Sep 16 16:14:11 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:11 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Attempting download of 4f1ed024-e14f-4371-8a39-a1d416ee528e ((None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}])) to volume 33b2d622-a7e5-44ac-b40e-54914bf9b245. {{(pid=86165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 16:14:11 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b96c678-0fa6-4e43-9702-f726ae0dc71e]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:14:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_9yogb6pr {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:12 devstack sudo[93852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_9yogb6pr
Sep 16 16:14:12 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:12 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_9yogb6pr" returned: 0 in 0.423s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_9yogb6pr {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:12 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ff951ae7-a245-46c0-98da-75c51db77e90 1073741824" returned: 0 in 0.683s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ff951ae7-a245-46c0-98da-75c51db77e90 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:12 devstack sudo[93863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_9yogb6pr
Sep 16 16:14:12 devstack sudo[93863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:12 devstack sudo[93865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ff951ae7-a245-46c0-98da-75c51db77e90
Sep 16 16:14:12 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:12 devstack sudo[93863]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_9yogb6pr" returned: 1 in 0.405s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_9yogb6pr' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:14:12 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c30c411-5330-4285-9a79-63fecd7065bb]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:14:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_tmw8g63_devstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:12 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ff951ae7-a245-46c0-98da-75c51db77e90" returned: 0 in 0.380s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:14:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e091720b-17fb-4067-b1e2-ab3debc78a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff951ae7-a245-46c0-98da-75c51db77e90', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0117d8f-ba04-40f3-940e-4e6851ce01d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:12 devstack sudo[93869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_tmw8g63_devstack@QuobyteHD
Sep 16 16:14:12 devstack sudo[93869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:12 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Volume volume-ff951ae7-a245-46c0-98da-75c51db77e90 (ff951ae7-a245-46c0-98da-75c51db77e90): created successfully
Sep 16 16:14:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0117d8f-ba04-40f3-940e-4e6851ce01d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Flow 'volume_create_manager' (7a17e78e-8116-43d6-85a1-038538c47911) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:14:13 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-7544abfd-accc-4636-a860-b92dd37d40e0 tempest-VolumesServicesTestJSON-1814288655 None] Created volume successfully.
Sep 16 16:14:13 devstack sudo[93869]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_tmw8g63_devstack@QuobyteHD" returned: 0 in 0.457s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:13 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] 4f1ed024-e14f-4371-8a39-a1d416ee528e was qcow2, converting to qcow2 {{(pid=86165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 16:14:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_tmw8g63_devstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:13 devstack sudo[93875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_tmw8g63_devstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245
Sep 16 16:14:13 devstack sudo[93875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:13 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24b1fee-8983-43bf-82e8-81d758da3e8d]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:14:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:13 devstack sudo[93877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c
Sep 16 16:14:13 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:13 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c" returned: 0 in 0.460s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:13 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afb591c-358e-48e8-a9b5-589ed7692e5b]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:14:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:13 devstack sudo[93887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c
Sep 16 16:14:13 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-90c3a471-0167-4bd5-8b66-d38740d17ee2 tempest-VolumesServicesTestJSON-1814288655 None] Acquiring lock "cinder-ff951ae7-a245-46c0-98da-75c51db77e90-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:14:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-90c3a471-0167-4bd5-8b66-d38740d17ee2 tempest-VolumesServicesTestJSON-1814288655 None] Lock "cinder-ff951ae7-a245-46c0-98da-75c51db77e90-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:14:14 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c" returned: 0 in 0.759s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c /opt/stack/data/cinder/conversion/cf145e64-7221-4e48-bd3a-d4d46b1ebe8c.temp_image.1e524c26-1e62-4afb-b6a3-9b1c3d66685bkmbxkqs5.img {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:14 devstack sudo[93913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c /opt/stack/data/cinder/conversion/cf145e64-7221-4e48-bd3a-d4d46b1ebe8c.temp_image.1e524c26-1e62-4afb-b6a3-9b1c3d66685bkmbxkqs5.img
Sep 16 16:14:14 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-90c3a471-0167-4bd5-8b66-d38740d17ee2 tempest-VolumesServicesTestJSON-1814288655 None] Acquiring lock "cinder-quobyte-ff951ae7-a245-46c0-98da-75c51db77e90" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:14:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-90c3a471-0167-4bd5-8b66-d38740d17ee2 tempest-VolumesServicesTestJSON-1814288655 None] Lock "cinder-quobyte-ff951ae7-a245-46c0-98da-75c51db77e90" acquired by "delete_volume" :: waited 0.060s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:14:14 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac5066b-fce0-49c4-a55b-290a6e648248]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:14:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-90c3a471-0167-4bd5-8b66-d38740d17ee2 tempest-VolumesServicesTestJSON-1814288655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ff951ae7-a245-46c0-98da-75c51db77e90 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:15 devstack sudo[93934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ff951ae7-a245-46c0-98da-75c51db77e90
Sep 16 16:14:15 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:16 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-90c3a471-0167-4bd5-8b66-d38740d17ee2 tempest-VolumesServicesTestJSON-1814288655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ff951ae7-a245-46c0-98da-75c51db77e90" returned: 0 in 1.166s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-90c3a471-0167-4bd5-8b66-d38740d17ee2 tempest-VolumesServicesTestJSON-1814288655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ff951ae7-a245-46c0-98da-75c51db77e90 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:16 devstack sudo[93973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ff951ae7-a245-46c0-98da-75c51db77e90
Sep 16 16:14:16 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:16 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-90c3a471-0167-4bd5-8b66-d38740d17ee2 tempest-VolumesServicesTestJSON-1814288655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ff951ae7-a245-46c0-98da-75c51db77e90" returned: 0 in 0.677s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-90c3a471-0167-4bd5-8b66-d38740d17ee2 tempest-VolumesServicesTestJSON-1814288655 None] Lock "cinder-quobyte-ff951ae7-a245-46c0-98da-75c51db77e90" released by "delete_volume" :: held 2.027s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:14:16 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-90c3a471-0167-4bd5-8b66-d38740d17ee2 tempest-VolumesServicesTestJSON-1814288655 None] Created reservations ['06c6cae3-7d7a-414f-9f61-b324831681df', 'a0a91f62-8856-4d2a-b404-4f0c32c4fe5e', '65fb5823-d478-4646-8af9-4dbd09591cf5', 'ea7b3215-24ed-4989-84f9-b97e056cffb5'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:14:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-90c3a471-0167-4bd5-8b66-d38740d17ee2 tempest-VolumesServicesTestJSON-1814288655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-90c3a471-0167-4bd5-8b66-d38740d17ee2 tempest-VolumesServicesTestJSON-1814288655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-90c3a471-0167-4bd5-8b66-d38740d17ee2 tempest-VolumesServicesTestJSON-1814288655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:14:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-90c3a471-0167-4bd5-8b66-d38740d17ee2 tempest-VolumesServicesTestJSON-1814288655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:14:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-90c3a471-0167-4bd5-8b66-d38740d17ee2 tempest-VolumesServicesTestJSON-1814288655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-90c3a471-0167-4bd5-8b66-d38740d17ee2 tempest-VolumesServicesTestJSON-1814288655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:17 devstack sudo[93982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:14:17 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:18 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-90c3a471-0167-4bd5-8b66-d38740d17ee2 tempest-VolumesServicesTestJSON-1814288655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.835s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:18 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-90c3a471-0167-4bd5-8b66-d38740d17ee2 tempest-VolumesServicesTestJSON-1814288655 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:14:18 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-90c3a471-0167-4bd5-8b66-d38740d17ee2 tempest-VolumesServicesTestJSON-1814288655 None] Deleted volume successfully.
Sep 16 16:14:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-90c3a471-0167-4bd5-8b66-d38740d17ee2 tempest-VolumesServicesTestJSON-1814288655 None] Lock "cinder-ff951ae7-a245-46c0-98da-75c51db77e90-delete_volume" released by "delete_volume" :: held 3.637s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:14:18 devstack sudo[93875]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_tmw8g63_devstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245" returned: 0 in 5.562s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:18 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_tmw8g63_devstack@QuobyteHD, size 112.00 MB, duration 5.56 sec, destination /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245 {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:14:18 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Converted 112.00 MB image at 20.13 MB/s
Sep 16 16:14:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:18 devstack sudo[93986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245 1G
Sep 16 16:14:18 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:19 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245 1G" returned: 0 in 1.148s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:19 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Downloaded image 4f1ed024-e14f-4371-8a39-a1d416ee528e ((None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}])) to volume 33b2d622-a7e5-44ac-b40e-54914bf9b245 successfully. {{(pid=86165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 16:14:19 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Temporary image 4f1ed024-e14f-4371-8a39-a1d416ee528e for user 5aee8b0dc3b04b66819d389bae0d5256 is deleted. {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 16:14:19 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Marking volume 33b2d622-a7e5-44ac-b40e-54914bf9b245 as bootable. {{(pid=86165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 16:14:20 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Copying metadata from image 4f1ed024-e14f-4371-8a39-a1d416ee528e to 33b2d622-a7e5-44ac-b40e-54914bf9b245. {{(pid=86165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 16:14:20 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Creating volume glance metadata for volume 33b2d622-a7e5-44ac-b40e-54914bf9b245 backed by image 4f1ed024-e14f-4371-8a39-a1d416ee528e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 16:14:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be76a60-b1a0-4c8f-93b2-333fef8cc206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33b2d622-a7e5-44ac-b40e-54914bf9b245', 'volume_size': 1, 'image_id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '896515a0bbf44034a5d624f4b911b6d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 2, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f1ed024-e14f-4371-8a39-a1d416ee528e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e41b5c290>}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69322f01-cafb-4d53-8e5c-557516677bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:20 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Volume volume-33b2d622-a7e5-44ac-b40e-54914bf9b245 (33b2d622-a7e5-44ac-b40e-54914bf9b245): created successfully
Sep 16 16:14:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69322f01-cafb-4d53-8e5c-557516677bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Flow 'volume_create_manager' (d64c20db-12d5-45e8-93a2-cbc11f54a478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:14:20 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-259d7bc8-1ffe-47b4-96ef-5d55d527d6f1 tempest-VolumesExtendTest-127782303 None] Created volume successfully.
Sep 16 16:14:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3a0220a1-a87c-433f-8cc7-09fc7bf9a385 tempest-VolumesExtendTest-127782303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:25 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c /opt/stack/data/cinder/conversion/cf145e64-7221-4e48-bd3a-d4d46b1ebe8c.temp_image.1e524c26-1e62-4afb-b6a3-9b1c3d66685bkmbxkqs5.img" returned: 0 in 10.929s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:25 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[52790963-6375-4850-9fd7-8b4b693cba66]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:14:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:25 devstack sudo[93994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c
Sep 16 16:14:25 devstack sudo[93994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:26 devstack sudo[93994]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c" returned: 0 in 0.585s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:26 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] Image conversion details: src /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c, size 1024.00 MB, duration 10.93 sec, destination /opt/stack/data/cinder/conversion/cf145e64-7221-4e48-bd3a-d4d46b1ebe8c.temp_image.1e524c26-1e62-4afb-b6a3-9b1c3d66685bkmbxkqs5.img {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:14:26 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] Converted 1024.00 MB image at 93.69 MB/s
Sep 16 16:14:26 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] 1e524c26-1e62-4afb-b6a3-9b1c3d66685b was raw, converting to qcow2 {{(pid=86165) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Sep 16 16:14:26 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdb5358-e748-4fde-a1be-ba82d05e7224]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:14:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cf145e64-7221-4e48-bd3a-d4d46b1ebe8c.temp_image.1e524c26-1e62-4afb-b6a3-9b1c3d66685bkmbxkqs5.img {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:26 devstack sudo[93999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cf145e64-7221-4e48-bd3a-d4d46b1ebe8c.temp_image.1e524c26-1e62-4afb-b6a3-9b1c3d66685bkmbxkqs5.img
Sep 16 16:14:26 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:26 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cf145e64-7221-4e48-bd3a-d4d46b1ebe8c.temp_image.1e524c26-1e62-4afb-b6a3-9b1c3d66685bkmbxkqs5.img" returned: 0 in 0.340s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cf145e64-7221-4e48-bd3a-d4d46b1ebe8c.temp_image.1e524c26-1e62-4afb-b6a3-9b1c3d66685bkmbxkqs5.img {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:26 devstack sudo[94003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cf145e64-7221-4e48-bd3a-d4d46b1ebe8c.temp_image.1e524c26-1e62-4afb-b6a3-9b1c3d66685bkmbxkqs5.img
Sep 16 16:14:26 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:26 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cf145e64-7221-4e48-bd3a-d4d46b1ebe8c.temp_image.1e524c26-1e62-4afb-b6a3-9b1c3d66685bkmbxkqs5.img" returned: 1 in 0.382s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cf145e64-7221-4e48-bd3a-d4d46b1ebe8c.temp_image.1e524c26-1e62-4afb-b6a3-9b1c3d66685bkmbxkqs5.img' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:14:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cf145e64-7221-4e48-bd3a-d4d46b1ebe8c.temp_image.1e524c26-1e62-4afb-b6a3-9b1c3d66685bkmbxkqs5.img /opt/stack/data/cinder/conversion/vol_upload_wrueb80n {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:26 devstack sudo[94008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cf145e64-7221-4e48-bd3a-d4d46b1ebe8c.temp_image.1e524c26-1e62-4afb-b6a3-9b1c3d66685bkmbxkqs5.img /opt/stack/data/cinder/conversion/vol_upload_wrueb80n
Sep 16 16:14:26 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:27 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cf145e64-7221-4e48-bd3a-d4d46b1ebe8c.temp_image.1e524c26-1e62-4afb-b6a3-9b1c3d66685bkmbxkqs5.img /opt/stack/data/cinder/conversion/vol_upload_wrueb80n" returned: 0 in 0.305s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:27 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] Image conversion details: src /opt/stack/data/cinder/conversion/cf145e64-7221-4e48-bd3a-d4d46b1ebe8c.temp_image.1e524c26-1e62-4afb-b6a3-9b1c3d66685bkmbxkqs5.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_wrueb80n {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:14:27 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 16 16:14:27 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccb654b-5771-4701-941f-3933daad498e]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:14:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wrueb80n {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:27 devstack sudo[94013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wrueb80n
Sep 16 16:14:27 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:27 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wrueb80n" returned: 0 in 0.397s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.858s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] Uploaded volume to glance image-id: 1e524c26-1e62-4afb-b6a3-9b1c3d66685b. {{(pid=86165) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 16 16:14:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3a0220a1-a87c-433f-8cc7-09fc7bf9a385 tempest-VolumesExtendTest-127782303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 7.381s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:29 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b67271b-b4ef-43f2-a889-41f42acd9ef7]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:14:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3a0220a1-a87c-433f-8cc7-09fc7bf9a385 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:29 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-80a5c397-d563-4806-a151-a2776d2664c3 tempest-VolumesActionsTest-302202208 None] Copy volume to image completed successfully.
Sep 16 16:14:29 devstack sudo[94018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245
Sep 16 16:14:29 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:29 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3a0220a1-a87c-433f-8cc7-09fc7bf9a385 tempest-VolumesExtendTest-127782303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245" returned: 0 in 0.500s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3a0220a1-a87c-433f-8cc7-09fc7bf9a385 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245 2G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3a0220a1-a87c-433f-8cc7-09fc7bf9a385 tempest-VolumesExtendTest-127782303 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245 2G" returned: 0 in 0.164s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3a0220a1-a87c-433f-8cc7-09fc7bf9a385 tempest-VolumesExtendTest-127782303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.709s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:29 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-3a0220a1-a87c-433f-8cc7-09fc7bf9a385 tempest-VolumesExtendTest-127782303 None] Extend volume completed successfully.
Sep 16 16:14:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b4ece6ae-5d8c-4d78-b86a-0b9c0f02c290 tempest-VolumesActionsTest-302202208 None] Acquiring lock "cinder-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:14:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b4ece6ae-5d8c-4d78-b86a-0b9c0f02c290 tempest-VolumesActionsTest-302202208 None] Lock "cinder-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:14:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b4ece6ae-5d8c-4d78-b86a-0b9c0f02c290 tempest-VolumesActionsTest-302202208 None] Acquiring lock "cinder-quobyte-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:14:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b4ece6ae-5d8c-4d78-b86a-0b9c0f02c290 tempest-VolumesActionsTest-302202208 None] Lock "cinder-quobyte-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c" acquired by "delete_volume" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:14:30 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d3176e-7466-4566-a87a-3ee247edf29c]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:14:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b4ece6ae-5d8c-4d78-b86a-0b9c0f02c290 tempest-VolumesActionsTest-302202208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:30 devstack sudo[94047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c
Sep 16 16:14:30 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:30 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b4ece6ae-5d8c-4d78-b86a-0b9c0f02c290 tempest-VolumesActionsTest-302202208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c" returned: 0 in 0.366s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b4ece6ae-5d8c-4d78-b86a-0b9c0f02c290 tempest-VolumesActionsTest-302202208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:30 devstack sudo[94052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c
Sep 16 16:14:30 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:30 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b4ece6ae-5d8c-4d78-b86a-0b9c0f02c290 tempest-VolumesActionsTest-302202208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c" returned: 0 in 0.269s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b4ece6ae-5d8c-4d78-b86a-0b9c0f02c290 tempest-VolumesActionsTest-302202208 None] Lock "cinder-quobyte-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c" released by "delete_volume" :: held 0.678s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:14:31 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-b4ece6ae-5d8c-4d78-b86a-0b9c0f02c290 tempest-VolumesActionsTest-302202208 None] Created reservations ['8d2f3af0-14a5-4eec-9638-d0eede34a177', 'd5e95247-0f70-43c4-88ff-15388c75df6d', '25c511b3-7839-45f4-895f-c6d60b79b31e', '48ba86f9-2290-4836-9795-2f84238932b1'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:14:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b4ece6ae-5d8c-4d78-b86a-0b9c0f02c290 tempest-VolumesActionsTest-302202208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b4ece6ae-5d8c-4d78-b86a-0b9c0f02c290 tempest-VolumesActionsTest-302202208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b4ece6ae-5d8c-4d78-b86a-0b9c0f02c290 tempest-VolumesActionsTest-302202208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:14:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b4ece6ae-5d8c-4d78-b86a-0b9c0f02c290 tempest-VolumesActionsTest-302202208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:14:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b4ece6ae-5d8c-4d78-b86a-0b9c0f02c290 tempest-VolumesActionsTest-302202208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b4ece6ae-5d8c-4d78-b86a-0b9c0f02c290 tempest-VolumesActionsTest-302202208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:31 devstack sudo[94055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:14:31 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5c1db011-4dc0-449e-99ca-d1be10dd32c3 tempest-VolumesExtendTest-127782303 None] Acquiring lock "cinder-33b2d622-a7e5-44ac-b40e-54914bf9b245-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:14:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5c1db011-4dc0-449e-99ca-d1be10dd32c3 tempest-VolumesExtendTest-127782303 None] Lock "cinder-33b2d622-a7e5-44ac-b40e-54914bf9b245-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:14:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5c1db011-4dc0-449e-99ca-d1be10dd32c3 tempest-VolumesExtendTest-127782303 None] Acquiring lock "cinder-quobyte-33b2d622-a7e5-44ac-b40e-54914bf9b245" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:14:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5c1db011-4dc0-449e-99ca-d1be10dd32c3 tempest-VolumesExtendTest-127782303 None] Lock "cinder-quobyte-33b2d622-a7e5-44ac-b40e-54914bf9b245" acquired by "delete_volume" :: waited 0.015s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:14:31 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cc552d-6735-4cc8-ba81-755cd9004d28]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:14:31 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5c1db011-4dc0-449e-99ca-d1be10dd32c3 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b4ece6ae-5d8c-4d78-b86a-0b9c0f02c290 tempest-VolumesActionsTest-302202208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.314s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:31 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-b4ece6ae-5d8c-4d78-b86a-0b9c0f02c290 tempest-VolumesActionsTest-302202208 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:14:31 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b4ece6ae-5d8c-4d78-b86a-0b9c0f02c290 tempest-VolumesActionsTest-302202208 None] Deleted volume successfully.
Sep 16 16:14:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b4ece6ae-5d8c-4d78-b86a-0b9c0f02c290 tempest-VolumesActionsTest-302202208 None] Lock "cinder-cf145e64-7221-4e48-bd3a-d4d46b1ebe8c-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:14:31 devstack sudo[94058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245
Sep 16 16:14:31 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:31 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5c1db011-4dc0-449e-99ca-d1be10dd32c3 tempest-VolumesExtendTest-127782303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245" returned: 0 in 0.436s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5c1db011-4dc0-449e-99ca-d1be10dd32c3 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:31 devstack sudo[94064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245
Sep 16 16:14:31 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:32 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5c1db011-4dc0-449e-99ca-d1be10dd32c3 tempest-VolumesExtendTest-127782303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2d622-a7e5-44ac-b40e-54914bf9b245" returned: 0 in 0.280s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5c1db011-4dc0-449e-99ca-d1be10dd32c3 tempest-VolumesExtendTest-127782303 None] Lock "cinder-quobyte-33b2d622-a7e5-44ac-b40e-54914bf9b245" released by "delete_volume" :: held 0.773s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:14:32 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-5c1db011-4dc0-449e-99ca-d1be10dd32c3 tempest-VolumesExtendTest-127782303 None] Created reservations ['3a3a27ff-406f-42fc-8d31-10fb781637de', '46a025a7-ec80-4ab8-ac07-2976bbbddd5c', 'd9d4a1e8-b2e1-4faa-b0fc-9388a1da3a08', '869228a1-8ab4-42eb-ac8e-99d46f123cb6'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:14:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5c1db011-4dc0-449e-99ca-d1be10dd32c3 tempest-VolumesExtendTest-127782303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5c1db011-4dc0-449e-99ca-d1be10dd32c3 tempest-VolumesExtendTest-127782303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5c1db011-4dc0-449e-99ca-d1be10dd32c3 tempest-VolumesExtendTest-127782303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:14:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5c1db011-4dc0-449e-99ca-d1be10dd32c3 tempest-VolumesExtendTest-127782303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:14:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5c1db011-4dc0-449e-99ca-d1be10dd32c3 tempest-VolumesExtendTest-127782303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5c1db011-4dc0-449e-99ca-d1be10dd32c3 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:32 devstack sudo[94067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:14:32 devstack sudo[94067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:32 devstack sudo[94067]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5c1db011-4dc0-449e-99ca-d1be10dd32c3 tempest-VolumesExtendTest-127782303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.287s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:32 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-5c1db011-4dc0-449e-99ca-d1be10dd32c3 tempest-VolumesExtendTest-127782303 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:14:32 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-5c1db011-4dc0-449e-99ca-d1be10dd32c3 tempest-VolumesExtendTest-127782303 None] Deleted volume successfully.
Sep 16 16:14:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5c1db011-4dc0-449e-99ca-d1be10dd32c3 tempest-VolumesExtendTest-127782303 None] Lock "cinder-33b2d622-a7e5-44ac-b40e-54914bf9b245-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Flow 'volume_create_manager' (502f0e39-2254-4d8e-8f0a-1c057844c2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def304e7-3c3b-4405-9ece-88719e26973d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def304e7-3c3b-4405-9ece-88719e26973d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-157247929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdca74b6-7b04-4dbb-94ac-091172a71cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8501ed8c76a44a68950d66507c4d7fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:33Z,use_quota=True,user_id='5aee8b0dc3b04b66819d389bae0d5256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa456d61-0f07-4ad5-ab27-4f00077fdd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa456d61-0f07-4ad5-ab27-4f00077fdd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d719d9cd-316f-442c-b5b6-27b473b2902f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d719d9cd-316f-442c-b5b6-27b473b2902f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdca74b6-7b04-4dbb-94ac-091172a71cce', 'volume_name': 'volume-bdca74b6-7b04-4dbb-94ac-091172a71cce', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627cbd7a-9873-44dd-8bff-80afd8335204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627cbd7a-9873-44dd-8bff-80afd8335204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5a5ace-3dea-464e-acae-788a6816d047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:33 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Volume bdca74b6-7b04-4dbb-94ac-091172a71cce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdca74b6-7b04-4dbb-94ac-091172a71cce', 'volume_size': 1}
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-157247929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdca74b6-7b04-4dbb-94ac-091172a71cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8501ed8c76a44a68950d66507c4d7fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:33Z,use_quota=True,user_id='5aee8b0dc3b04b66819d389bae0d5256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Creating volume bdca74b6-7b04-4dbb-94ac-091172a71cce {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:14:33 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:33 devstack sudo[94070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce 1073741824
Sep 16 16:14:33 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:33 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce 1073741824" returned: 0 in 0.489s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:33 devstack sudo[94077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce
Sep 16 16:14:33 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:34 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce" returned: 0 in 0.317s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:14:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5a5ace-3dea-464e-acae-788a6816d047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdca74b6-7b04-4dbb-94ac-091172a71cce', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f69aa568-a394-4ee9-b43e-0e4d66e5cb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:34 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Volume volume-bdca74b6-7b04-4dbb-94ac-091172a71cce (bdca74b6-7b04-4dbb-94ac-091172a71cce): created successfully
Sep 16 16:14:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f69aa568-a394-4ee9-b43e-0e4d66e5cb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Flow 'volume_create_manager' (502f0e39-2254-4d8e-8f0a-1c057844c2c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:14:34 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-78cb7f1e-7ed0-4778-8f66-64de8ac7ba34 tempest-VolumesExtendTest-127782303 None] Created volume successfully.
Sep 16 16:14:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f1243ef5-ff13-4ca1-bf04-34b631d376e0 tempest-VolumesExtendTest-127782303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f1243ef5-ff13-4ca1-bf04-34b631d376e0 tempest-VolumesExtendTest-127782303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-f1243ef5-ff13-4ca1-bf04-34b631d376e0 tempest-VolumesExtendTest-127782303 None] Creating offline snapshot 835abfaa-7e48-42a5-8c15-b9a2ecd47aae of volume bdca74b6-7b04-4dbb-94ac-091172a71cce {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:14:35 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4473a3f2-dfc8-43cc-b40f-dd0f668e4515]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:14:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f1243ef5-ff13-4ca1-bf04-34b631d376e0 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:35 devstack sudo[94080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce
Sep 16 16:14:35 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:36 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f1243ef5-ff13-4ca1-bf04-34b631d376e0 tempest-VolumesExtendTest-127782303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce" returned: 0 in 0.641s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f1243ef5-ff13-4ca1-bf04-34b631d376e0 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.835abfaa-7e48-42a5-8c15-b9a2ecd47aae 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:36 devstack sudo[94085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.835abfaa-7e48-42a5-8c15-b9a2ecd47aae 1G
Sep 16 16:14:36 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:36 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f1243ef5-ff13-4ca1-bf04-34b631d376e0 tempest-VolumesExtendTest-127782303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.835abfaa-7e48-42a5-8c15-b9a2ecd47aae 1G" returned: 0 in 0.630s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f1243ef5-ff13-4ca1-bf04-34b631d376e0 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdca74b6-7b04-4dbb-94ac-091172a71cce -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.835abfaa-7e48-42a5-8c15-b9a2ecd47aae {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:36 devstack sudo[94092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdca74b6-7b04-4dbb-94ac-091172a71cce -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.835abfaa-7e48-42a5-8c15-b9a2ecd47aae
Sep 16 16:14:36 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:37 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f1243ef5-ff13-4ca1-bf04-34b631d376e0 tempest-VolumesExtendTest-127782303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bdca74b6-7b04-4dbb-94ac-091172a71cce -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.835abfaa-7e48-42a5-8c15-b9a2ecd47aae" returned: 0 in 0.510s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:37 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-f1243ef5-ff13-4ca1-bf04-34b631d376e0 tempest-VolumesExtendTest-127782303 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.835abfaa-7e48-42a5-8c15-b9a2ecd47aae is being set with open permissions: ugo+rw
Sep 16 16:14:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f1243ef5-ff13-4ca1-bf04-34b631d376e0 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.835abfaa-7e48-42a5-8c15-b9a2ecd47aae {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:37 devstack sudo[94099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.835abfaa-7e48-42a5-8c15-b9a2ecd47aae
Sep 16 16:14:37 devstack sudo[94099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:37 devstack sudo[94099]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f1243ef5-ff13-4ca1-bf04-34b631d376e0 tempest-VolumesExtendTest-127782303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.835abfaa-7e48-42a5-8c15-b9a2ecd47aae" returned: 0 in 0.308s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f1243ef5-ff13-4ca1-bf04-34b631d376e0 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:37 devstack sudo[94102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.info
Sep 16 16:14:37 devstack sudo[94102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:37 devstack sudo[94102]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f1243ef5-ff13-4ca1-bf04-34b631d376e0 tempest-VolumesExtendTest-127782303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.info" returned: 0 in 0.362s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:37 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-f1243ef5-ff13-4ca1-bf04-34b631d376e0 tempest-VolumesExtendTest-127782303 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.info is being set with open permissions: ugo+rw
Sep 16 16:14:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f1243ef5-ff13-4ca1-bf04-34b631d376e0 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:37 devstack sudo[94105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.info
Sep 16 16:14:37 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:38 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f1243ef5-ff13-4ca1-bf04-34b631d376e0 tempest-VolumesExtendTest-127782303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.info" returned: 0 in 0.295s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f1243ef5-ff13-4ca1-bf04-34b631d376e0 tempest-VolumesExtendTest-127782303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.894s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:38 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-f1243ef5-ff13-4ca1-bf04-34b631d376e0 tempest-VolumesExtendTest-127782303 None] Create snapshot completed successfully
Sep 16 16:14:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-456d9086-874e-42df-b667-9ee3162e6e31 tempest-VolumesExtendTest-127782303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-456d9086-874e-42df-b667-9ee3162e6e31 tempest-VolumesExtendTest-127782303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:38 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3105a07-86c8-4c39-bbf1-ee045390d938]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:14:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-456d9086-874e-42df-b667-9ee3162e6e31 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:38 devstack sudo[94108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce
Sep 16 16:14:38 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:39 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-456d9086-874e-42df-b667-9ee3162e6e31 tempest-VolumesExtendTest-127782303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce" returned: 0 in 0.443s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-456d9086-874e-42df-b667-9ee3162e6e31 tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.835abfaa-7e48-42a5-8c15-b9a2ecd47aae 2G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-456d9086-874e-42df-b667-9ee3162e6e31 tempest-VolumesExtendTest-127782303 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.835abfaa-7e48-42a5-8c15-b9a2ecd47aae 2G" returned: 0 in 0.166s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-456d9086-874e-42df-b667-9ee3162e6e31 tempest-VolumesExtendTest-127782303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.666s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:39 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-456d9086-874e-42df-b667-9ee3162e6e31 tempest-VolumesExtendTest-127782303 None] Extend volume completed successfully.
Sep 16 16:14:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ebd5f718-4f1a-4ace-9e7e-b83f86f58bde tempest-VolumesExtendTest-127782303 None] Acquiring lock "cinder-835abfaa-7e48-42a5-8c15-b9a2ecd47aae-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:14:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ebd5f718-4f1a-4ace-9e7e-b83f86f58bde tempest-VolumesExtendTest-127782303 None] Lock "cinder-835abfaa-7e48-42a5-8c15-b9a2ecd47aae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:14:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ebd5f718-4f1a-4ace-9e7e-b83f86f58bde tempest-VolumesExtendTest-127782303 None] Acquiring lock "cinder-quobyte-bdca74b6-7b04-4dbb-94ac-091172a71cce" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:14:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ebd5f718-4f1a-4ace-9e7e-b83f86f58bde tempest-VolumesExtendTest-127782303 None] Lock "cinder-quobyte-bdca74b6-7b04-4dbb-94ac-091172a71cce" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:14:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ebd5f718-4f1a-4ace-9e7e-b83f86f58bde tempest-VolumesExtendTest-127782303 None] Acquiring lock "cinder-quobyte-835abfaa-7e48-42a5-8c15-b9a2ecd47aae" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:14:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ebd5f718-4f1a-4ace-9e7e-b83f86f58bde tempest-VolumesExtendTest-127782303 None] Lock "cinder-quobyte-835abfaa-7e48-42a5-8c15-b9a2ecd47aae" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:14:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-ebd5f718-4f1a-4ace-9e7e-b83f86f58bde tempest-VolumesExtendTest-127782303 None] Deleting offline snapshot 835abfaa-7e48-42a5-8c15-b9a2ecd47aae of volume bdca74b6-7b04-4dbb-94ac-091172a71cce {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-ebd5f718-4f1a-4ace-9e7e-b83f86f58bde tempest-VolumesExtendTest-127782303 None] snapshot_file for this snap is: volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.835abfaa-7e48-42a5-8c15-b9a2ecd47aae {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a4977c-8e4e-471d-b1ce-e6e22d516a5d]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ebd5f718-4f1a-4ace-9e7e-b83f86f58bde tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.835abfaa-7e48-42a5-8c15-b9a2ecd47aae {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:40 devstack sudo[94121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.835abfaa-7e48-42a5-8c15-b9a2ecd47aae
Sep 16 16:14:40 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:40 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ebd5f718-4f1a-4ace-9e7e-b83f86f58bde tempest-VolumesExtendTest-127782303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.835abfaa-7e48-42a5-8c15-b9a2ecd47aae" returned: 0 in 0.449s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-ebd5f718-4f1a-4ace-9e7e-b83f86f58bde tempest-VolumesExtendTest-127782303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bdca74b6-7b04-4dbb-94ac-091172a71cce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[36537bb1-163b-4062-95be-cde25487e99c]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ebd5f718-4f1a-4ace-9e7e-b83f86f58bde tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:40 devstack sudo[94128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce
Sep 16 16:14:40 devstack sudo[94128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Flow 'volume_create_manager' (e8ed8b5d-1390-46b0-b898-5bc7422dfa6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8159cdd3-2cb4-4e56-b80c-56403f6ce231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8159cdd3-2cb4-4e56-b80c-56403f6ce231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1300778958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51dfda61-45e7-4781-8be2-902df8fa5921,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='88b4d3e35aa8409c95706e74c9a88f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:41Z,use_quota=True,user_id='ae3fc78098fe4c0899f05371fb451101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5171561f-0fb1-49f0-b766-1ad9a7e41988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5171561f-0fb1-49f0-b766-1ad9a7e41988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb94fe3-3ee9-46c2-a36e-b635b583d94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb94fe3-3ee9-46c2-a36e-b635b583d94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51dfda61-45e7-4781-8be2-902df8fa5921', 'volume_name': 'volume-51dfda61-45e7-4781-8be2-902df8fa5921', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9f9e26-40bf-4ea7-bf4a-34f76dcc6cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca9f9e26-40bf-4ea7-bf4a-34f76dcc6cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5054106f-5437-422d-96fc-84cee12cbb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:40 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Volume 51dfda61-45e7-4781-8be2-902df8fa5921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51dfda61-45e7-4781-8be2-902df8fa5921', 'volume_size': 1}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1300778958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51dfda61-45e7-4781-8be2-902df8fa5921,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='88b4d3e35aa8409c95706e74c9a88f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:41Z,use_quota=True,user_id='ae3fc78098fe4c0899f05371fb451101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Creating volume 51dfda61-45e7-4781-8be2-902df8fa5921 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:14:40 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-51dfda61-45e7-4781-8be2-902df8fa5921 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:40 devstack sudo[94128]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ebd5f718-4f1a-4ace-9e7e-b83f86f58bde tempest-VolumesExtendTest-127782303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce" returned: 0 in 0.409s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ebd5f718-4f1a-4ace-9e7e-b83f86f58bde tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.835abfaa-7e48-42a5-8c15-b9a2ecd47aae {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:40 devstack sudo[94133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-51dfda61-45e7-4781-8be2-902df8fa5921 1073741824
Sep 16 16:14:40 devstack sudo[94133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:40 devstack sudo[94134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.835abfaa-7e48-42a5-8c15-b9a2ecd47aae
Sep 16 16:14:40 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:41 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ebd5f718-4f1a-4ace-9e7e-b83f86f58bde tempest-VolumesExtendTest-127782303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.835abfaa-7e48-42a5-8c15-b9a2ecd47aae" returned: 0 in 0.430s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ebd5f718-4f1a-4ace-9e7e-b83f86f58bde tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.835abfaa-7e48-42a5-8c15-b9a2ecd47aae {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:41 devstack sudo[94145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.835abfaa-7e48-42a5-8c15-b9a2ecd47aae
Sep 16 16:14:41 devstack sudo[94145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:41 devstack sudo[94133]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-51dfda61-45e7-4781-8be2-902df8fa5921 1073741824" returned: 0 in 0.485s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-51dfda61-45e7-4781-8be2-902df8fa5921 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:41 devstack sudo[94149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-51dfda61-45e7-4781-8be2-902df8fa5921
Sep 16 16:14:41 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:41 devstack sudo[94145]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ebd5f718-4f1a-4ace-9e7e-b83f86f58bde tempest-VolumesExtendTest-127782303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce.835abfaa-7e48-42a5-8c15-b9a2ecd47aae" returned: 0 in 0.331s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ebd5f718-4f1a-4ace-9e7e-b83f86f58bde tempest-VolumesExtendTest-127782303 None] Lock "cinder-quobyte-835abfaa-7e48-42a5-8c15-b9a2ecd47aae" released by "_delete_snapshot" :: held 1.774s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:14:41 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-51dfda61-45e7-4781-8be2-902df8fa5921" returned: 0 in 0.324s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:41 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:14:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ebd5f718-4f1a-4ace-9e7e-b83f86f58bde tempest-VolumesExtendTest-127782303 None] Lock "cinder-quobyte-bdca74b6-7b04-4dbb-94ac-091172a71cce" released by "delete_snapshot" :: held 1.813s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:14:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5054106f-5437-422d-96fc-84cee12cbb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51dfda61-45e7-4781-8be2-902df8fa5921', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5540b59e-4268-4ad0-aad9-8553ed09a3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:41 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Volume volume-51dfda61-45e7-4781-8be2-902df8fa5921 (51dfda61-45e7-4781-8be2-902df8fa5921): created successfully
Sep 16 16:14:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5540b59e-4268-4ad0-aad9-8553ed09a3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Flow 'volume_create_manager' (e8ed8b5d-1390-46b0-b898-5bc7422dfa6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:14:41 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-693e577e-367c-439c-99d2-c7ed8b7c8b8d tempest-VolumesGetTest-201328229 None] Created volume successfully.
Sep 16 16:14:41 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-ebd5f718-4f1a-4ace-9e7e-b83f86f58bde tempest-VolumesExtendTest-127782303 None] Created reservations ['f40ab967-6e7c-4e86-9ce1-57f4402e18a5', '62db3c58-6289-4d94-8da7-9fad825655ad', '01a7c2e9-c3bf-4114-ad6a-1fd99cf035e3', '96de023d-19dd-4669-b333-651da659af87'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:14:41 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-ebd5f718-4f1a-4ace-9e7e-b83f86f58bde tempest-VolumesExtendTest-127782303 None] Delete snapshot completed successfully.
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ebd5f718-4f1a-4ace-9e7e-b83f86f58bde tempest-VolumesExtendTest-127782303 None] Lock "cinder-835abfaa-7e48-42a5-8c15-b9a2ecd47aae-delete_snapshot" released by "delete_snapshot" :: held 2.060s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1379c57c-c75b-4df8-9a42-c86b13b1dd0f tempest-VolumesExtendTest-127782303 None] Acquiring lock "cinder-bdca74b6-7b04-4dbb-94ac-091172a71cce-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1379c57c-c75b-4df8-9a42-c86b13b1dd0f tempest-VolumesExtendTest-127782303 None] Lock "cinder-bdca74b6-7b04-4dbb-94ac-091172a71cce-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1379c57c-c75b-4df8-9a42-c86b13b1dd0f tempest-VolumesExtendTest-127782303 None] Acquiring lock "cinder-quobyte-bdca74b6-7b04-4dbb-94ac-091172a71cce" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1379c57c-c75b-4df8-9a42-c86b13b1dd0f tempest-VolumesExtendTest-127782303 None] Lock "cinder-quobyte-bdca74b6-7b04-4dbb-94ac-091172a71cce" acquired by "delete_volume" :: waited 0.021s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e22874e-c436-45f3-b1cb-572f4b6fc838]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1379c57c-c75b-4df8-9a42-c86b13b1dd0f tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:42 devstack sudo[94157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce
Sep 16 16:14:42 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Flow 'volume_create_manager' (37511f20-9831-40fa-8f76-0aadfee50ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec1daa4-8959-4582-a729-c5863aa74001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec1daa4-8959-4582-a729-c5863aa74001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-407566907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e611585f-09f8-4268-88e1-e1c5979fa2a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b60be1392b4fa695313361f48663b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:43Z,use_quota=True,user_id='68b6a671260d4721925db004de72ce99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d04bfb-38b0-481f-8ca7-4fb1a8fcf1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d04bfb-38b0-481f-8ca7-4fb1a8fcf1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434b8478-d925-4714-8a6c-fcb13b667298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434b8478-d925-4714-8a6c-fcb13b667298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e611585f-09f8-4268-88e1-e1c5979fa2a8', 'volume_name': 'volume-e611585f-09f8-4268-88e1-e1c5979fa2a8', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4447b09a-49bd-4ebb-8d57-a39b8d00b585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4447b09a-49bd-4ebb-8d57-a39b8d00b585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (435f2e53-1235-4bde-bd9f-5688fbb2344d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:42 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Volume e611585f-09f8-4268-88e1-e1c5979fa2a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e611585f-09f8-4268-88e1-e1c5979fa2a8', 'volume_size': 1}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-407566907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e611585f-09f8-4268-88e1-e1c5979fa2a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b60be1392b4fa695313361f48663b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:43Z,use_quota=True,user_id='68b6a671260d4721925db004de72ce99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Creating volume e611585f-09f8-4268-88e1-e1c5979fa2a8 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:14:42 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e611585f-09f8-4268-88e1-e1c5979fa2a8 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:42 devstack sudo[94163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e611585f-09f8-4268-88e1-e1c5979fa2a8 1073741824
Sep 16 16:14:42 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:42 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1379c57c-c75b-4df8-9a42-c86b13b1dd0f tempest-VolumesExtendTest-127782303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce" returned: 0 in 0.585s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1379c57c-c75b-4df8-9a42-c86b13b1dd0f tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:42 devstack sudo[94172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce
Sep 16 16:14:42 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:43 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1379c57c-c75b-4df8-9a42-c86b13b1dd0f tempest-VolumesExtendTest-127782303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bdca74b6-7b04-4dbb-94ac-091172a71cce" returned: 0 in 0.427s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1379c57c-c75b-4df8-9a42-c86b13b1dd0f tempest-VolumesExtendTest-127782303 None] Lock "cinder-quobyte-bdca74b6-7b04-4dbb-94ac-091172a71cce" released by "delete_volume" :: held 1.126s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:14:43 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-1379c57c-c75b-4df8-9a42-c86b13b1dd0f tempest-VolumesExtendTest-127782303 None] Created reservations ['d03c7a51-7d89-450c-8433-b716a3073391', '04a52cdf-0dc4-4023-aecc-96d121c65ce7', '161f635d-4df9-444c-be7f-2bce43b4cd74', '35e2d0c4-b5a3-481e-9e3f-ee78d6746a67'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:14:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1379c57c-c75b-4df8-9a42-c86b13b1dd0f tempest-VolumesExtendTest-127782303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1379c57c-c75b-4df8-9a42-c86b13b1dd0f tempest-VolumesExtendTest-127782303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1379c57c-c75b-4df8-9a42-c86b13b1dd0f tempest-VolumesExtendTest-127782303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:14:43 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1379c57c-c75b-4df8-9a42-c86b13b1dd0f tempest-VolumesExtendTest-127782303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:14:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1379c57c-c75b-4df8-9a42-c86b13b1dd0f tempest-VolumesExtendTest-127782303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1379c57c-c75b-4df8-9a42-c86b13b1dd0f tempest-VolumesExtendTest-127782303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e611585f-09f8-4268-88e1-e1c5979fa2a8 1073741824" returned: 0 in 0.891s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:43 devstack sudo[94180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:14:43 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e611585f-09f8-4268-88e1-e1c5979fa2a8 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:43 devstack sudo[94182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e611585f-09f8-4268-88e1-e1c5979fa2a8
Sep 16 16:14:43 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:43 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1379c57c-c75b-4df8-9a42-c86b13b1dd0f tempest-VolumesExtendTest-127782303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.324s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:43 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-1379c57c-c75b-4df8-9a42-c86b13b1dd0f tempest-VolumesExtendTest-127782303 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:14:43 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-1379c57c-c75b-4df8-9a42-c86b13b1dd0f tempest-VolumesExtendTest-127782303 None] Deleted volume successfully.
Sep 16 16:14:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1379c57c-c75b-4df8-9a42-c86b13b1dd0f tempest-VolumesExtendTest-127782303 None] Lock "cinder-bdca74b6-7b04-4dbb-94ac-091172a71cce-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:14:44 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e611585f-09f8-4268-88e1-e1c5979fa2a8" returned: 0 in 0.357s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (435f2e53-1235-4bde-bd9f-5688fbb2344d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e611585f-09f8-4268-88e1-e1c5979fa2a8', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1ceede2-6b2e-4ca8-9f8f-71e7d19071e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:44 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Volume volume-e611585f-09f8-4268-88e1-e1c5979fa2a8 (e611585f-09f8-4268-88e1-e1c5979fa2a8): created successfully
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1ceede2-6b2e-4ca8-9f8f-71e7d19071e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Flow 'volume_create_manager' (37511f20-9831-40fa-8f76-0aadfee50ea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:14:44 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-436102b8-bd10-4fd1-b6c0-75c78f510656 tempest-AttachVolumeTestJSON-1114470276 None] Created volume successfully.
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Flow 'volume_create_manager' (660a51f4-bf99-4a4d-9277-5e96f3564bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfefc965-3a52-4f08-a35e-498f54795764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfefc965-3a52-4f08-a35e-498f54795764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:14:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1700894861',display_name='tempest-VolumesGetTest-Volume-1329138055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a58d2e80-75b3-436e-8995-075688cc6243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88b4d3e35aa8409c95706e74c9a88f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:44Z,use_quota=True,user_id='ae3fc78098fe4c0899f05371fb451101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd797b08-4b44-48be-8d84-1d8fd4dedb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd797b08-4b44-48be-8d84-1d8fd4dedb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5310a22-cbf6-4133-83ad-061a64fbb7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5310a22-cbf6-4133-83ad-061a64fbb7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a58d2e80-75b3-436e-8995-075688cc6243', 'volume_name': 'volume-a58d2e80-75b3-436e-8995-075688cc6243', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6282ac0b-b9b0-4876-8de5-ebbe3326ce9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6282ac0b-b9b0-4876-8de5-ebbe3326ce9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd782da-2a81-46d8-8bc9-3f3fb200529a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:44 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Volume a58d2e80-75b3-436e-8995-075688cc6243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a58d2e80-75b3-436e-8995-075688cc6243', 'volume_size': 1}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:14:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1700894861',display_name='tempest-VolumesGetTest-Volume-1329138055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a58d2e80-75b3-436e-8995-075688cc6243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88b4d3e35aa8409c95706e74c9a88f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:44Z,use_quota=True,user_id='ae3fc78098fe4c0899f05371fb451101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Creating volume a58d2e80-75b3-436e-8995-075688cc6243 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:14:44 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:14:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a58d2e80-75b3-436e-8995-075688cc6243 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:44 devstack sudo[94186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a58d2e80-75b3-436e-8995-075688cc6243 1073741824
Sep 16 16:14:44 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:45 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a58d2e80-75b3-436e-8995-075688cc6243 1073741824" returned: 0 in 0.608s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a58d2e80-75b3-436e-8995-075688cc6243 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:45 devstack sudo[94196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a58d2e80-75b3-436e-8995-075688cc6243
Sep 16 16:14:45 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:45 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a58d2e80-75b3-436e-8995-075688cc6243" returned: 0 in 0.322s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:14:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd782da-2a81-46d8-8bc9-3f3fb200529a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a58d2e80-75b3-436e-8995-075688cc6243', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1bd84a5-19e5-48d0-9f3c-cf4f8c9f449e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:45 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Volume volume-a58d2e80-75b3-436e-8995-075688cc6243 (a58d2e80-75b3-436e-8995-075688cc6243): created successfully
Sep 16 16:14:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1bd84a5-19e5-48d0-9f3c-cf4f8c9f449e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Flow 'volume_create_manager' (660a51f4-bf99-4a4d-9277-5e96f3564bd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:14:45 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-59288c1b-52b4-46e5-8d34-abe313b4c983 tempest-VolumesGetTest-201328229 None] Created volume successfully.
Sep 16 16:14:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-2dccdf04-12f8-4d36-b487-79cc20d03c6b req-81887869-5c26-40de-b1f6-41b4b0c5b3eb tempest-AttachVolumeTestJSON-1114470276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-2dccdf04-12f8-4d36-b487-79cc20d03c6b req-81887869-5c26-40de-b1f6-41b4b0c5b3eb tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-2dccdf04-12f8-4d36-b487-79cc20d03c6b req-81887869-5c26-40de-b1f6-41b4b0c5b3eb tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-2dccdf04-12f8-4d36-b487-79cc20d03c6b req-81887869-5c26-40de-b1f6-41b4b0c5b3eb tempest-AttachVolumeTestJSON-1114470276 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-e611585f-09f8-4268-88e1-e1c5979fa2a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b31ff000-28f7-4777-b6f5-fbf45a3a561c', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:14:45 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-2dccdf04-12f8-4d36-b487-79cc20d03c6b req-81887869-5c26-40de-b1f6-41b4b0c5b3eb tempest-AttachVolumeTestJSON-1114470276 None] attachment_update completed successfully.
Sep 16 16:14:46 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-25c955bb-7109-4206-97c8-b9a2e30f1309 tempest-VolumesGetTest-201328229 None] Acquiring lock "cinder-a58d2e80-75b3-436e-8995-075688cc6243-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:14:46 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-25c955bb-7109-4206-97c8-b9a2e30f1309 tempest-VolumesGetTest-201328229 None] Lock "cinder-a58d2e80-75b3-436e-8995-075688cc6243-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:14:46 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-25c955bb-7109-4206-97c8-b9a2e30f1309 tempest-VolumesGetTest-201328229 None] Acquiring lock "cinder-quobyte-a58d2e80-75b3-436e-8995-075688cc6243" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:14:46 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-25c955bb-7109-4206-97c8-b9a2e30f1309 tempest-VolumesGetTest-201328229 None] Lock "cinder-quobyte-a58d2e80-75b3-436e-8995-075688cc6243" acquired by "delete_volume" :: waited 0.028s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:14:46 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1726cab-af2b-4c12-812a-1a312a34a3b5]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:14:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-25c955bb-7109-4206-97c8-b9a2e30f1309 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a58d2e80-75b3-436e-8995-075688cc6243 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:46 devstack sudo[94620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a58d2e80-75b3-436e-8995-075688cc6243
Sep 16 16:14:46 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:47 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-25c955bb-7109-4206-97c8-b9a2e30f1309 tempest-VolumesGetTest-201328229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a58d2e80-75b3-436e-8995-075688cc6243" returned: 0 in 0.434s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-25c955bb-7109-4206-97c8-b9a2e30f1309 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a58d2e80-75b3-436e-8995-075688cc6243 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:47 devstack sudo[94625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a58d2e80-75b3-436e-8995-075688cc6243
Sep 16 16:14:47 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:47 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-25c955bb-7109-4206-97c8-b9a2e30f1309 tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a58d2e80-75b3-436e-8995-075688cc6243" returned: 0 in 0.334s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:47 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-25c955bb-7109-4206-97c8-b9a2e30f1309 tempest-VolumesGetTest-201328229 None] Lock "cinder-quobyte-a58d2e80-75b3-436e-8995-075688cc6243" released by "delete_volume" :: held 0.871s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:14:47 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-25c955bb-7109-4206-97c8-b9a2e30f1309 tempest-VolumesGetTest-201328229 None] Created reservations ['c68cdaca-4cd2-4d03-b902-f69e0a62d554', '7300420c-a929-4346-a428-d6a36588b44e', 'd6bfd4e6-8323-4c08-a8da-f92663ef223a', '13870710-49c0-4f30-9f93-f6792c586bc3'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:14:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-25c955bb-7109-4206-97c8-b9a2e30f1309 tempest-VolumesGetTest-201328229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-25c955bb-7109-4206-97c8-b9a2e30f1309 tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-25c955bb-7109-4206-97c8-b9a2e30f1309 tempest-VolumesGetTest-201328229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:14:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-25c955bb-7109-4206-97c8-b9a2e30f1309 tempest-VolumesGetTest-201328229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:14:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-25c955bb-7109-4206-97c8-b9a2e30f1309 tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-25c955bb-7109-4206-97c8-b9a2e30f1309 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:48 devstack sudo[94628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:14:48 devstack sudo[94628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:48 devstack sudo[94628]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-25c955bb-7109-4206-97c8-b9a2e30f1309 tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.406s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:48 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-25c955bb-7109-4206-97c8-b9a2e30f1309 tempest-VolumesGetTest-201328229 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:14:48 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-25c955bb-7109-4206-97c8-b9a2e30f1309 tempest-VolumesGetTest-201328229 None] Deleted volume successfully.
Sep 16 16:14:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-25c955bb-7109-4206-97c8-b9a2e30f1309 tempest-VolumesGetTest-201328229 None] Lock "cinder-a58d2e80-75b3-436e-8995-075688cc6243-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-28304321-1d89-4600-98cb-057d2989d3d3 tempest-VolumesGetTest-201328229 None] Acquiring lock "cinder-51dfda61-45e7-4781-8be2-902df8fa5921-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-28304321-1d89-4600-98cb-057d2989d3d3 tempest-VolumesGetTest-201328229 None] Lock "cinder-51dfda61-45e7-4781-8be2-902df8fa5921-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-28304321-1d89-4600-98cb-057d2989d3d3 tempest-VolumesGetTest-201328229 None] Acquiring lock "cinder-quobyte-51dfda61-45e7-4781-8be2-902df8fa5921" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-28304321-1d89-4600-98cb-057d2989d3d3 tempest-VolumesGetTest-201328229 None] Lock "cinder-quobyte-51dfda61-45e7-4781-8be2-902df8fa5921" acquired by "delete_volume" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1acc91-eb04-4d7f-8b70-3e145ec934dc]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-28304321-1d89-4600-98cb-057d2989d3d3 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-51dfda61-45e7-4781-8be2-902df8fa5921 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:49 devstack sudo[94637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-51dfda61-45e7-4781-8be2-902df8fa5921
Sep 16 16:14:49 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:49 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-28304321-1d89-4600-98cb-057d2989d3d3 tempest-VolumesGetTest-201328229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-51dfda61-45e7-4781-8be2-902df8fa5921" returned: 0 in 0.436s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-28304321-1d89-4600-98cb-057d2989d3d3 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-51dfda61-45e7-4781-8be2-902df8fa5921 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:49 devstack sudo[94642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-51dfda61-45e7-4781-8be2-902df8fa5921
Sep 16 16:14:49 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Flow 'volume_create_manager' (db3f8807-9c8b-40df-9480-7fc091e05b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16da8177-aa13-4639-b333-c620fd140c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16da8177-aa13-4639-b333-c620fd140c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1378202721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4995867-d52d-4fd3-b2b3-47d7c99b8011,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='373697dae52a43b983aecc7acc37f89f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:50Z,use_quota=True,user_id='5bc5c6f8228c49b1b4c015006293ec44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b808c6-3bb1-4e5c-9e14-da0e842657cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b808c6-3bb1-4e5c-9e14-da0e842657cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290416a2-2a8e-41e6-aa2e-ebdb40c123cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290416a2-2a8e-41e6-aa2e-ebdb40c123cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4995867-d52d-4fd3-b2b3-47d7c99b8011', 'volume_name': 'volume-d4995867-d52d-4fd3-b2b3-47d7c99b8011', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a477852d-b396-4e91-80bd-e0abf9b95c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a477852d-b396-4e91-80bd-e0abf9b95c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e730f418-7272-4fb2-a06e-badbed94f5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:49 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Volume d4995867-d52d-4fd3-b2b3-47d7c99b8011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4995867-d52d-4fd3-b2b3-47d7c99b8011', 'volume_size': 1}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1378202721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4995867-d52d-4fd3-b2b3-47d7c99b8011,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='373697dae52a43b983aecc7acc37f89f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:50Z,use_quota=True,user_id='5bc5c6f8228c49b1b4c015006293ec44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Creating volume d4995867-d52d-4fd3-b2b3-47d7c99b8011 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:14:49 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d4995867-d52d-4fd3-b2b3-47d7c99b8011 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:49 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-28304321-1d89-4600-98cb-057d2989d3d3 tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-51dfda61-45e7-4781-8be2-902df8fa5921" returned: 0 in 0.324s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:49 devstack sudo[94645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d4995867-d52d-4fd3-b2b3-47d7c99b8011 1073741824
Sep 16 16:14:49 devstack sudo[94645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-28304321-1d89-4600-98cb-057d2989d3d3 tempest-VolumesGetTest-201328229 None] Lock "cinder-quobyte-51dfda61-45e7-4781-8be2-902df8fa5921" released by "delete_volume" :: held 0.809s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:14:49 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-28304321-1d89-4600-98cb-057d2989d3d3 tempest-VolumesGetTest-201328229 None] Created reservations ['ee0b606e-7438-478e-9f6c-a7ed8b7af3ac', 'a632911e-0fe5-46e3-a416-5f06f3780ffc', 'fa235aa0-f011-460a-94f7-6f6e97450131', '0cd292a2-cda8-4afc-b532-7d5cfb4c3c48'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:14:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-28304321-1d89-4600-98cb-057d2989d3d3 tempest-VolumesGetTest-201328229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-28304321-1d89-4600-98cb-057d2989d3d3 tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:50 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-28304321-1d89-4600-98cb-057d2989d3d3 tempest-VolumesGetTest-201328229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:14:50 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-28304321-1d89-4600-98cb-057d2989d3d3 tempest-VolumesGetTest-201328229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:14:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-28304321-1d89-4600-98cb-057d2989d3d3 tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-28304321-1d89-4600-98cb-057d2989d3d3 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:50 devstack sudo[94648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:14:50 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:50 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-28304321-1d89-4600-98cb-057d2989d3d3 tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.450s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:50 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-28304321-1d89-4600-98cb-057d2989d3d3 tempest-VolumesGetTest-201328229 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:14:50 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-28304321-1d89-4600-98cb-057d2989d3d3 tempest-VolumesGetTest-201328229 None] Deleted volume successfully.
Sep 16 16:14:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-28304321-1d89-4600-98cb-057d2989d3d3 tempest-VolumesGetTest-201328229 None] Lock "cinder-51dfda61-45e7-4781-8be2-902df8fa5921-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:14:50 devstack sudo[94645]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d4995867-d52d-4fd3-b2b3-47d7c99b8011 1073741824" returned: 0 in 0.806s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d4995867-d52d-4fd3-b2b3-47d7c99b8011 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:50 devstack sudo[94656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d4995867-d52d-4fd3-b2b3-47d7c99b8011
Sep 16 16:14:50 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:50 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:14:50 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Flow 'volume_create_manager' (85758525-1a11-4716-b7af-41ddc9fd9f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:14:50 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfb1bac-cec9-4a47-83aa-9841634e720a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfb1bac-cec9-4a47-83aa-9841634e720a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-789653873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbdb05a8-f736-416d-9ddc-735e29ef8340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88b4d3e35aa8409c95706e74c9a88f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:51Z,use_quota=True,user_id='ae3fc78098fe4c0899f05371fb451101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c37b735a-247e-4966-9de2-f24f46bfea10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c37b735a-247e-4966-9de2-f24f46bfea10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ec40ba-477c-4d65-9a5f-f40b53b95a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ec40ba-477c-4d65-9a5f-f40b53b95a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbdb05a8-f736-416d-9ddc-735e29ef8340', 'volume_name': 'volume-dbdb05a8-f736-416d-9ddc-735e29ef8340', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04f1105e-e850-405f-ac69-0756685b4410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04f1105e-e850-405f-ac69-0756685b4410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8597e066-f05d-465b-95c0-744b8ea69acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:51 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Volume dbdb05a8-f736-416d-9ddc-735e29ef8340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbdb05a8-f736-416d-9ddc-735e29ef8340', 'volume_size': 1}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:51 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d4995867-d52d-4fd3-b2b3-47d7c99b8011" returned: 0 in 0.367s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.056s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-789653873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbdb05a8-f736-416d-9ddc-735e29ef8340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88b4d3e35aa8409c95706e74c9a88f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:51Z,use_quota=True,user_id='ae3fc78098fe4c0899f05371fb451101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Creating volume dbdb05a8-f736-416d-9ddc-735e29ef8340 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:14:51 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e730f418-7272-4fb2-a06e-badbed94f5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4995867-d52d-4fd3-b2b3-47d7c99b8011', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345c0460-0770-4564-8fd3-2f2c86402b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:51 devstack sudo[94659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340 1073741824
Sep 16 16:14:51 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:51 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Volume volume-d4995867-d52d-4fd3-b2b3-47d7c99b8011 (d4995867-d52d-4fd3-b2b3-47d7c99b8011): created successfully
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345c0460-0770-4564-8fd3-2f2c86402b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Flow 'volume_create_manager' (db3f8807-9c8b-40df-9480-7fc091e05b7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:14:51 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-ea6e0c66-35c4-4dd1-8f93-060ee61494d0 tempest-VolumesListTestJSON-380087 None] Created volume successfully.
Sep 16 16:14:51 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340 1073741824" returned: 0 in 0.804s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:52 devstack sudo[94729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340
Sep 16 16:14:52 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:52 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340" returned: 0 in 0.549s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8597e066-f05d-465b-95c0-744b8ea69acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbdb05a8-f736-416d-9ddc-735e29ef8340', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff6efa2-3195-4daa-a138-ec6e5a682bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:52 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Volume volume-dbdb05a8-f736-416d-9ddc-735e29ef8340 (dbdb05a8-f736-416d-9ddc-735e29ef8340): created successfully
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff6efa2-3195-4daa-a138-ec6e5a682bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Flow 'volume_create_manager' (85758525-1a11-4716-b7af-41ddc9fd9f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:14:52 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-4536be4c-8277-4b57-b2a9-130223572a44 tempest-VolumesGetTest-201328229 None] Created volume successfully.
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Flow 'volume_create_manager' (c2f78217-2067-4868-aeb0-25168df7f577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee99821d-b52a-4151-a76e-c24919fe1f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee99821d-b52a-4151-a76e-c24919fe1f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-477594435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c63b6b6-86ea-4f2d-a032-04c511991f12,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='373697dae52a43b983aecc7acc37f89f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:53Z,use_quota=True,user_id='5bc5c6f8228c49b1b4c015006293ec44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f181aa3-87c6-43cc-b8f0-51576ad6c512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f181aa3-87c6-43cc-b8f0-51576ad6c512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801a1cba-a10d-46f8-8c27-12a168c0dfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801a1cba-a10d-46f8-8c27-12a168c0dfe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c63b6b6-86ea-4f2d-a032-04c511991f12', 'volume_name': 'volume-1c63b6b6-86ea-4f2d-a032-04c511991f12', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db60c415-d4e7-417d-89ab-0e6de335b2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db60c415-d4e7-417d-89ab-0e6de335b2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61bc7c41-2d2d-4b19-974c-bea898bd277d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:52 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Volume 1c63b6b6-86ea-4f2d-a032-04c511991f12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c63b6b6-86ea-4f2d-a032-04c511991f12', 'volume_size': 1}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-477594435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c63b6b6-86ea-4f2d-a032-04c511991f12,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='373697dae52a43b983aecc7acc37f89f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:53Z,use_quota=True,user_id='5bc5c6f8228c49b1b4c015006293ec44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Creating volume 1c63b6b6-86ea-4f2d-a032-04c511991f12 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:14:52 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:14:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c63b6b6-86ea-4f2d-a032-04c511991f12 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:53 devstack sudo[94814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c63b6b6-86ea-4f2d-a032-04c511991f12 1073741824
Sep 16 16:14:53 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:53 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c63b6b6-86ea-4f2d-a032-04c511991f12 1073741824" returned: 0 in 0.832s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c63b6b6-86ea-4f2d-a032-04c511991f12 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:54 devstack sudo[95182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c63b6b6-86ea-4f2d-a032-04c511991f12
Sep 16 16:14:54 devstack sudo[95182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Flow 'volume_create_manager' (d50a3718-e606-48b4-815b-88252dd979f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4bde676-b36f-47c9-87cb-778789ca300f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4bde676-b36f-47c9-87cb-778789ca300f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-165187855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb043593-6b30-4e39-b497-3f7897c25486,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='88b4d3e35aa8409c95706e74c9a88f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=dbdb05a8-f736-416d-9ddc-735e29ef8340,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:54Z,use_quota=True,user_id='ae3fc78098fe4c0899f05371fb451101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417987bb-b483-4dfb-8998-e3e7d239ac2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417987bb-b483-4dfb-8998-e3e7d239ac2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb51a63-500b-4b99-9153-c9917dfa0700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:54 devstack sudo[95182]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c63b6b6-86ea-4f2d-a032-04c511991f12" returned: 0 in 0.611s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb51a63-500b-4b99-9153-c9917dfa0700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fb043593-6b30-4e39-b497-3f7897c25486', 'volume_name': 'volume-fb043593-6b30-4e39-b497-3f7897c25486', 'volume_size': 1, 'source_volid': 'dbdb05a8-f736-416d-9ddc-735e29ef8340', 'source_volstatus': 'available'}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd176a31-0a73-480c-84c9-54e15f97ec42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd176a31-0a73-480c-84c9-54e15f97ec42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5502d8-c41c-4ed7-b174-970b7cf86585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:54 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Volume fb043593-6b30-4e39-b497-3f7897c25486: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fb043593-6b30-4e39-b497-3f7897c25486', 'volume_size': 1, 'source_volid': 'dbdb05a8-f736-416d-9ddc-735e29ef8340', 'source_volstatus': 'available'}
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:54 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Cloning volume dbdb05a8-f736-416d-9ddc-735e29ef8340 to volume fb043593-6b30-4e39-b497-3f7897c25486
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61bc7c41-2d2d-4b19-974c-bea898bd277d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c63b6b6-86ea-4f2d-a032-04c511991f12', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c12f271-1792-4e6f-a5f1-0e2f26f79d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:54 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Volume volume-1c63b6b6-86ea-4f2d-a032-04c511991f12 (1c63b6b6-86ea-4f2d-a032-04c511991f12): created successfully
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c12f271-1792-4e6f-a5f1-0e2f26f79d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Flow 'volume_create_manager' (c2f78217-2067-4868-aeb0-25168df7f577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Creating offline snapshot 60aa9f8e-cdb5-4466-87d7-9691e29f7dbd of volume dbdb05a8-f736-416d-9ddc-735e29ef8340 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:14:54 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-8d7da9f6-9312-4e8a-8253-6e1724dbf3c4 tempest-VolumesListTestJSON-380087 None] Created volume successfully.
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dabd9c-7433-419c-b194-edcd4512dc43]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:14:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:54 devstack sudo[95206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340
Sep 16 16:14:54 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:55 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340" returned: 0 in 0.672s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:55 devstack sudo[95212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd 1G
Sep 16 16:14:55 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:56 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:14:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Flow 'volume_create_manager' (f16fdac2-da65-4b7e-98ed-040f6aeedbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:14:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1961e9-0979-488a-a718-fb10a1054c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1961e9-0979-488a-a718-fb10a1054c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-335931623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8fb7e6-d98e-4804-8d10-dcd96bf242a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='373697dae52a43b983aecc7acc37f89f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:56Z,use_quota=True,user_id='5bc5c6f8228c49b1b4c015006293ec44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d768d5d2-4823-4198-9123-d4b9c80242e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d768d5d2-4823-4198-9123-d4b9c80242e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d2bb888-0f57-4ca1-80aa-bd3bbbee09c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:56 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d2bb888-0f57-4ca1-80aa-bd3bbbee09c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad8fb7e6-d98e-4804-8d10-dcd96bf242a2', 'volume_name': 'volume-ad8fb7e6-d98e-4804-8d10-dcd96bf242a2', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ae8fa7-2aaf-4165-9ec9-69e8290e9fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ae8fa7-2aaf-4165-9ec9-69e8290e9fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:14:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096ffce2-e242-4919-a4ca-00f464cb1909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:14:56 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Volume ad8fb7e6-d98e-4804-8d10-dcd96bf242a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad8fb7e6-d98e-4804-8d10-dcd96bf242a2', 'volume_size': 1}
Sep 16 16:14:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd 1G" returned: 0 in 1.213s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbdb05a8-f736-416d-9ddc-735e29ef8340 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:56 devstack sudo[95222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbdb05a8-f736-416d-9ddc-735e29ef8340 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd
Sep 16 16:14:56 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:57 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbdb05a8-f736-416d-9ddc-735e29ef8340 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd" returned: 0 in 0.575s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:57 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd is being set with open permissions: ugo+rw
Sep 16 16:14:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:57 devstack sudo[95261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd
Sep 16 16:14:57 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:57 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd" returned: 0 in 0.404s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:57 devstack sudo[95266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.info
Sep 16 16:14:57 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:58 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.info" returned: 0 in 0.369s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:58 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.info is being set with open permissions: ugo+rw
Sep 16 16:14:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:58 devstack sudo[95269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.info
Sep 16 16:14:58 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:58 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.info" returned: 0 in 0.305s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:58 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Acquiring lock "cinder-quobyte-fb043593-6b30-4e39-b497-3f7897c25486" by "_copy_volume_from_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:14:58 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Lock "cinder-quobyte-fb043593-6b30-4e39-b497-3f7897c25486" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:14:58 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] snapshot: 60aa9f8e-cdb5-4466-87d7-9691e29f7dbd, volume: fb043593-6b30-4e39-b497-3f7897c25486,  {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 16:14:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:14:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:14:58 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:14:58 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:14:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:14:58 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[175a5691-122b-4f75-86b0-db42c98f4f25]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:14:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:58 devstack sudo[95272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd
Sep 16 16:14:58 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:58 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd" returned: 0 in 0.504s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:58 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbdb05a8-f736-416d-9ddc-735e29ef8340(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:14:58 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d2a4b9-b73d-4a59-bccd-17ba1fb1c196]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:14:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:59 devstack sudo[95277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340
Sep 16 16:14:59 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:14:59 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root
Sep 16 16:14:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340" returned: 0 in 0.532s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:14:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] will copy from snapshot at /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340 {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 16:14:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Creating direct copy from snapshot {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 16:14:59 devstack cinder-volume[86165]: DEBUG cinder.utils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Path /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fb043593-6b30-4e39-b497-3f7897c25486 not found in is_blk_device check {{(pid=86165) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 16:14:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fb043593-6b30-4e39-b497-3f7897c25486 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:14:59 devstack sudo[95283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fb043593-6b30-4e39-b497-3f7897c25486
Sep 16 16:14:59 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:15:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:07 devstack sudo[95301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:15:07 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:07 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=71,cinder:UPDATE=98,cinder:DELETE=9,cinder:INSERT=22 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:15:07 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=87,cinder:INSERT=30,cinder:UPDATE=86,cinder:DELETE=7 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:15:08 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.847s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:08 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:15:08 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:15:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 28 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:15:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>, <Thread(tpool_thread_0, started daemon 135438770624192)>, <Thread(tpool_thread_1, started daemon 135438762231488)>, <Thread(tpool_thread_2, started daemon 135438753838784)>, <Thread(tpool_thread_3, started daemon 135438745446080)>, <Thread(tpool_thread_4, started daemon 135438737053376)>, <Thread(tpool_thread_5, started daemon 135438728660672)>, <Thread(tpool_thread_6, started daemon 135438720267968)>, <Thread(tpool_thread_7, started daemon 135438711875264)>, <Thread(tpool_thread_8, started daemon 135438703466176)>, <Thread(tpool_thread_9, started daemon 135438695057088)>, <Thread(tpool_thread_10, started daemon 135438686648000)>, <Thread(tpool_thread_11, started daemon 135438678238912)>, <Thread(tpool_thread_12, started daemon 135438669829824)>, <Thread(tpool_thread_13, started daemon 135438661420736)>, <Thread(tpool_thread_14, started daemon 135438653011648)>, <Thread(tpool_thread_15, started daemon 135438644602560)>, <Thread(tpool_thread_16, started daemon 135438636193472)>, <Thread(tpool_thread_17, started daemon 135438627784384)>, <Thread(tpool_thread_18, started daemon 135438619375296)>, <Thread(tpool_thread_19, started daemon 135438610966208)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:15:08 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fb043593-6b30-4e39-b497-3f7897c25486" returned: 0 in 8.817s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:08 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Image conversion details: src /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340, size 1024.00 MB, duration 8.82 sec, destination /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fb043593-6b30-4e39-b497-3f7897c25486 {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:15:08 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Converted 1024.00 MB image at 116.12 MB/s
Sep 16 16:15:08 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fb043593-6b30-4e39-b497-3f7897c25486 is being set with open permissions: ugo+rw
Sep 16 16:15:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fb043593-6b30-4e39-b497-3f7897c25486 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:08 devstack sudo[95309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fb043593-6b30-4e39-b497-3f7897c25486
Sep 16 16:15:08 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:08 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fb043593-6b30-4e39-b497-3f7897c25486" returned: 0 in 0.312s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:08 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Lock "cinder-quobyte-fb043593-6b30-4e39-b497-3f7897c25486" released by "_copy_volume_from_snapshot" :: held 10.270s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:08 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Acquiring lock "cinder-quobyte-60aa9f8e-cdb5-4466-87d7-9691e29f7dbd" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:08 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Lock "cinder-quobyte-60aa9f8e-cdb5-4466-87d7-9691e29f7dbd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Deleting offline snapshot 60aa9f8e-cdb5-4466-87d7-9691e29f7dbd of volume dbdb05a8-f736-416d-9ddc-735e29ef8340 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:15:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] snapshot_file for this snap is: volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:15:08 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac53457-150e-4bbe-a025-7e816fae4b78]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:08 devstack sudo[95312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd
Sep 16 16:15:08 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:09 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd" returned: 0 in 0.531s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbdb05a8-f736-416d-9ddc-735e29ef8340(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:15:09 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f136a2c-c14c-40f3-b70d-ef3820856edd]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:09 devstack sudo[95318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340
Sep 16 16:15:09 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:09 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340" returned: 0 in 0.595s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:09 devstack sudo[95323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd
Sep 16 16:15:09 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:10 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd" returned: 0 in 0.397s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:10 devstack sudo[95330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd
Sep 16 16:15:10 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:10 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340.60aa9f8e-cdb5-4466-87d7-9691e29f7dbd" returned: 0 in 0.297s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:10 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Lock "cinder-quobyte-60aa9f8e-cdb5-4466-87d7-9691e29f7dbd" released by "_delete_snapshot" :: held 1.954s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.107s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.110s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-335931623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8fb7e6-d98e-4804-8d10-dcd96bf242a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='373697dae52a43b983aecc7acc37f89f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:56Z,use_quota=True,user_id='5bc5c6f8228c49b1b4c015006293ec44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:15:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Creating volume ad8fb7e6-d98e-4804-8d10-dcd96bf242a2 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:15:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:15:10 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:15:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ad8fb7e6-d98e-4804-8d10-dcd96bf242a2 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5502d8-c41c-4ed7-b174-970b7cf86585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb043593-6b30-4e39-b497-3f7897c25486', 'volume_size': 1, 'source_volid': 'dbdb05a8-f736-416d-9ddc-735e29ef8340', 'source_volstatus': 'available'}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:10 devstack sudo[95333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ad8fb7e6-d98e-4804-8d10-dcd96bf242a2 1073741824
Sep 16 16:15:10 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8ae2a6d-20f2-4c99-b505-37bbc6bc53f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:10 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Volume volume-fb043593-6b30-4e39-b497-3f7897c25486 (fb043593-6b30-4e39-b497-3f7897c25486): created successfully
Sep 16 16:15:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8ae2a6d-20f2-4c99-b505-37bbc6bc53f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Flow 'volume_create_manager' (d50a3718-e606-48b4-815b-88252dd979f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:10 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-e9b77a73-19d6-4071-bf12-f5bca894149c tempest-VolumesGetTest-201328229 None] Created volume successfully.
Sep 16 16:15:11 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ad8fb7e6-d98e-4804-8d10-dcd96bf242a2 1073741824" returned: 0 in 0.501s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ad8fb7e6-d98e-4804-8d10-dcd96bf242a2 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:11 devstack sudo[95339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ad8fb7e6-d98e-4804-8d10-dcd96bf242a2
Sep 16 16:15:11 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:11 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ad8fb7e6-d98e-4804-8d10-dcd96bf242a2" returned: 0 in 0.305s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096ffce2-e242-4919-a4ca-00f464cb1909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad8fb7e6-d98e-4804-8d10-dcd96bf242a2', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4321603-7a29-4b96-8907-4f8bd258e1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:11 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Volume volume-ad8fb7e6-d98e-4804-8d10-dcd96bf242a2 (ad8fb7e6-d98e-4804-8d10-dcd96bf242a2): created successfully
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4321603-7a29-4b96-8907-4f8bd258e1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Flow 'volume_create_manager' (f16fdac2-da65-4b7e-98ed-040f6aeedbb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:11 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-cbeaf294-55cc-49ea-bb01-129c37b12476 tempest-VolumesListTestJSON-380087 None] Created volume successfully.
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Flow 'volume_create_manager' (9b454320-33d3-4037-a9b2-f83361b9fbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f127145-8f19-445b-bdfd-74a2e16b3605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f127145-8f19-445b-bdfd-74a2e16b3605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:15:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1406403731',display_name='tempest-VolumesGetTest-Volume-1379376687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23b4da8b-8cef-432b-a2b8-af716a08fa37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88b4d3e35aa8409c95706e74c9a88f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:12Z,use_quota=True,user_id='ae3fc78098fe4c0899f05371fb451101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c6dbf1-59a9-4ae8-b479-8e0576fb468d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c6dbf1-59a9-4ae8-b479-8e0576fb468d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1755f17-a700-4c98-8ab6-84356e4d6470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1755f17-a700-4c98-8ab6-84356e4d6470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23b4da8b-8cef-432b-a2b8-af716a08fa37', 'volume_name': 'volume-23b4da8b-8cef-432b-a2b8-af716a08fa37', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b119138-d153-4289-bff9-cdc0bdc11f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b119138-d153-4289-bff9-cdc0bdc11f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9923b327-e592-427d-b49f-ada1436163bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:11 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Volume 23b4da8b-8cef-432b-a2b8-af716a08fa37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23b4da8b-8cef-432b-a2b8-af716a08fa37', 'volume_size': 1}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:15:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1406403731',display_name='tempest-VolumesGetTest-Volume-1379376687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23b4da8b-8cef-432b-a2b8-af716a08fa37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88b4d3e35aa8409c95706e74c9a88f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:12Z,use_quota=True,user_id='ae3fc78098fe4c0899f05371fb451101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Creating volume 23b4da8b-8cef-432b-a2b8-af716a08fa37 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:15:12 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:15:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-23b4da8b-8cef-432b-a2b8-af716a08fa37 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:12 devstack sudo[95342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-23b4da8b-8cef-432b-a2b8-af716a08fa37 1073741824
Sep 16 16:15:12 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:12 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-23b4da8b-8cef-432b-a2b8-af716a08fa37 1073741824" returned: 0 in 0.567s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-23b4da8b-8cef-432b-a2b8-af716a08fa37 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:12 devstack sudo[95378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-23b4da8b-8cef-432b-a2b8-af716a08fa37
Sep 16 16:15:12 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:12 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-23b4da8b-8cef-432b-a2b8-af716a08fa37" returned: 0 in 0.353s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:15:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9923b327-e592-427d-b49f-ada1436163bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23b4da8b-8cef-432b-a2b8-af716a08fa37', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015dece7-bfd9-4e81-9ec5-36db7c1d09b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:13 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Volume volume-23b4da8b-8cef-432b-a2b8-af716a08fa37 (23b4da8b-8cef-432b-a2b8-af716a08fa37): created successfully
Sep 16 16:15:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015dece7-bfd9-4e81-9ec5-36db7c1d09b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Flow 'volume_create_manager' (9b454320-33d3-4037-a9b2-f83361b9fbaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:13 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-bd5f308b-7be4-49f6-84b9-cbfe0c2f58c4 tempest-VolumesGetTest-201328229 None] Created volume successfully.
Sep 16 16:15:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-95ee0807-5f1f-40aa-a4a2-c7ff6b5452c0 tempest-VolumesGetTest-201328229 None] Acquiring lock "cinder-23b4da8b-8cef-432b-a2b8-af716a08fa37-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-95ee0807-5f1f-40aa-a4a2-c7ff6b5452c0 tempest-VolumesGetTest-201328229 None] Lock "cinder-23b4da8b-8cef-432b-a2b8-af716a08fa37-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-95ee0807-5f1f-40aa-a4a2-c7ff6b5452c0 tempest-VolumesGetTest-201328229 None] Acquiring lock "cinder-quobyte-23b4da8b-8cef-432b-a2b8-af716a08fa37" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-95ee0807-5f1f-40aa-a4a2-c7ff6b5452c0 tempest-VolumesGetTest-201328229 None] Lock "cinder-quobyte-23b4da8b-8cef-432b-a2b8-af716a08fa37" acquired by "delete_volume" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:14 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6b0a40-f0a8-4adb-a7c0-d19faa8228d6]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-95ee0807-5f1f-40aa-a4a2-c7ff6b5452c0 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-23b4da8b-8cef-432b-a2b8-af716a08fa37 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:14 devstack sudo[95381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-23b4da8b-8cef-432b-a2b8-af716a08fa37
Sep 16 16:15:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ea28dd8d-3562-4c8e-ac93-67db916cc482 tempest-VolumesListTestJSON-380087 None] Acquiring lock "cinder-ad8fb7e6-d98e-4804-8d10-dcd96bf242a2-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:14 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ea28dd8d-3562-4c8e-ac93-67db916cc482 tempest-VolumesListTestJSON-380087 None] Lock "cinder-ad8fb7e6-d98e-4804-8d10-dcd96bf242a2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ea28dd8d-3562-4c8e-ac93-67db916cc482 tempest-VolumesListTestJSON-380087 None] Acquiring lock "cinder-quobyte-ad8fb7e6-d98e-4804-8d10-dcd96bf242a2" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ea28dd8d-3562-4c8e-ac93-67db916cc482 tempest-VolumesListTestJSON-380087 None] Lock "cinder-quobyte-ad8fb7e6-d98e-4804-8d10-dcd96bf242a2" acquired by "delete_volume" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:14 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c65d47-a14e-4576-ab0c-744849b16359]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ea28dd8d-3562-4c8e-ac93-67db916cc482 tempest-VolumesListTestJSON-380087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ad8fb7e6-d98e-4804-8d10-dcd96bf242a2 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:14 devstack sudo[95383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ad8fb7e6-d98e-4804-8d10-dcd96bf242a2
Sep 16 16:15:14 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:14 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-95ee0807-5f1f-40aa-a4a2-c7ff6b5452c0 tempest-VolumesGetTest-201328229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-23b4da8b-8cef-432b-a2b8-af716a08fa37" returned: 0 in 0.460s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-95ee0807-5f1f-40aa-a4a2-c7ff6b5452c0 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-23b4da8b-8cef-432b-a2b8-af716a08fa37 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:14 devstack sudo[95388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-23b4da8b-8cef-432b-a2b8-af716a08fa37
Sep 16 16:15:14 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:15 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ea28dd8d-3562-4c8e-ac93-67db916cc482 tempest-VolumesListTestJSON-380087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ad8fb7e6-d98e-4804-8d10-dcd96bf242a2" returned: 0 in 0.424s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ea28dd8d-3562-4c8e-ac93-67db916cc482 tempest-VolumesListTestJSON-380087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ad8fb7e6-d98e-4804-8d10-dcd96bf242a2 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:15 devstack sudo[95396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ad8fb7e6-d98e-4804-8d10-dcd96bf242a2
Sep 16 16:15:15 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:15 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-95ee0807-5f1f-40aa-a4a2-c7ff6b5452c0 tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-23b4da8b-8cef-432b-a2b8-af716a08fa37" returned: 0 in 0.284s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-95ee0807-5f1f-40aa-a4a2-c7ff6b5452c0 tempest-VolumesGetTest-201328229 None] Lock "cinder-quobyte-23b4da8b-8cef-432b-a2b8-af716a08fa37" released by "delete_volume" :: held 0.843s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-95ee0807-5f1f-40aa-a4a2-c7ff6b5452c0 tempest-VolumesGetTest-201328229 None] Created reservations ['1b73ccc6-0b08-4638-b575-19f404f1465e', '975c4f97-1b84-477e-83f7-1ce205062ac0', 'b69104b1-b97f-4862-8fe7-20e14851105c', 'b5c323df-6473-4b42-b16c-1a3f77af322d'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-95ee0807-5f1f-40aa-a4a2-c7ff6b5452c0 tempest-VolumesGetTest-201328229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-95ee0807-5f1f-40aa-a4a2-c7ff6b5452c0 tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-95ee0807-5f1f-40aa-a4a2-c7ff6b5452c0 tempest-VolumesGetTest-201328229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-95ee0807-5f1f-40aa-a4a2-c7ff6b5452c0 tempest-VolumesGetTest-201328229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-95ee0807-5f1f-40aa-a4a2-c7ff6b5452c0 tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-95ee0807-5f1f-40aa-a4a2-c7ff6b5452c0 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:15 devstack sudo[95400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:15:15 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:15 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ea28dd8d-3562-4c8e-ac93-67db916cc482 tempest-VolumesListTestJSON-380087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ad8fb7e6-d98e-4804-8d10-dcd96bf242a2" returned: 0 in 0.300s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ea28dd8d-3562-4c8e-ac93-67db916cc482 tempest-VolumesListTestJSON-380087 None] Lock "cinder-quobyte-ad8fb7e6-d98e-4804-8d10-dcd96bf242a2" released by "delete_volume" :: held 0.778s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c87a1981-54b5-48a7-a87f-8bcc2d8ca00e tempest-VolumesGetTest-201328229 None] Acquiring lock "cinder-fb043593-6b30-4e39-b497-3f7897c25486-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-ea28dd8d-3562-4c8e-ac93-67db916cc482 tempest-VolumesListTestJSON-380087 None] Created reservations ['0b7474e8-bee3-47ee-91db-b57c165dab71', '8722cb71-d787-4634-82c8-fc1c18ccf234', '3770c7ce-8f0d-4bd3-a819-992f3ae5f758', 'bca7af06-79b1-4b63-9d12-2fd0ee7f5412'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c87a1981-54b5-48a7-a87f-8bcc2d8ca00e tempest-VolumesGetTest-201328229 None] Lock "cinder-fb043593-6b30-4e39-b497-3f7897c25486-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c87a1981-54b5-48a7-a87f-8bcc2d8ca00e tempest-VolumesGetTest-201328229 None] Acquiring lock "cinder-quobyte-fb043593-6b30-4e39-b497-3f7897c25486" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ea28dd8d-3562-4c8e-ac93-67db916cc482 tempest-VolumesListTestJSON-380087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ea28dd8d-3562-4c8e-ac93-67db916cc482 tempest-VolumesListTestJSON-380087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ea28dd8d-3562-4c8e-ac93-67db916cc482 tempest-VolumesListTestJSON-380087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:15 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ea28dd8d-3562-4c8e-ac93-67db916cc482 tempest-VolumesListTestJSON-380087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ea28dd8d-3562-4c8e-ac93-67db916cc482 tempest-VolumesListTestJSON-380087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ea28dd8d-3562-4c8e-ac93-67db916cc482 tempest-VolumesListTestJSON-380087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c87a1981-54b5-48a7-a87f-8bcc2d8ca00e tempest-VolumesGetTest-201328229 None] Lock "cinder-quobyte-fb043593-6b30-4e39-b497-3f7897c25486" acquired by "delete_volume" :: waited 0.057s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:15 devstack sudo[95403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:15:15 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-95ee0807-5f1f-40aa-a4a2-c7ff6b5452c0 tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.345s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-95ee0807-5f1f-40aa-a4a2-c7ff6b5452c0 tempest-VolumesGetTest-201328229 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:15:15 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-95ee0807-5f1f-40aa-a4a2-c7ff6b5452c0 tempest-VolumesGetTest-201328229 None] Deleted volume successfully.
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[722cdf6d-84d7-438d-8416-188c2a075267]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c87a1981-54b5-48a7-a87f-8bcc2d8ca00e tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fb043593-6b30-4e39-b497-3f7897c25486 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-95ee0807-5f1f-40aa-a4a2-c7ff6b5452c0 tempest-VolumesGetTest-201328229 None] Lock "cinder-23b4da8b-8cef-432b-a2b8-af716a08fa37-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:15 devstack sudo[95405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fb043593-6b30-4e39-b497-3f7897c25486
Sep 16 16:15:15 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4f475a9e-b43d-4e86-9b91-300b4b313847 tempest-VolumesListTestJSON-380087 None] Acquiring lock "cinder-1c63b6b6-86ea-4f2d-a032-04c511991f12-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4f475a9e-b43d-4e86-9b91-300b4b313847 tempest-VolumesListTestJSON-380087 None] Lock "cinder-1c63b6b6-86ea-4f2d-a032-04c511991f12-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4f475a9e-b43d-4e86-9b91-300b4b313847 tempest-VolumesListTestJSON-380087 None] Acquiring lock "cinder-quobyte-1c63b6b6-86ea-4f2d-a032-04c511991f12" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4f475a9e-b43d-4e86-9b91-300b4b313847 tempest-VolumesListTestJSON-380087 None] Lock "cinder-quobyte-1c63b6b6-86ea-4f2d-a032-04c511991f12" acquired by "delete_volume" :: waited 0.029s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:16 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ea28dd8d-3562-4c8e-ac93-67db916cc482 tempest-VolumesListTestJSON-380087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.501s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:16 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-ea28dd8d-3562-4c8e-ac93-67db916cc482 tempest-VolumesListTestJSON-380087 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:15:16 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-ea28dd8d-3562-4c8e-ac93-67db916cc482 tempest-VolumesListTestJSON-380087 None] Deleted volume successfully.
Sep 16 16:15:16 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[02923c02-a973-474a-ac39-216448eee223]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4f475a9e-b43d-4e86-9b91-300b4b313847 tempest-VolumesListTestJSON-380087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c63b6b6-86ea-4f2d-a032-04c511991f12 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ea28dd8d-3562-4c8e-ac93-67db916cc482 tempest-VolumesListTestJSON-380087 None] Lock "cinder-ad8fb7e6-d98e-4804-8d10-dcd96bf242a2-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:16 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c87a1981-54b5-48a7-a87f-8bcc2d8ca00e tempest-VolumesGetTest-201328229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fb043593-6b30-4e39-b497-3f7897c25486" returned: 0 in 0.612s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c87a1981-54b5-48a7-a87f-8bcc2d8ca00e tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fb043593-6b30-4e39-b497-3f7897c25486 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:16 devstack sudo[95409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c63b6b6-86ea-4f2d-a032-04c511991f12
Sep 16 16:15:16 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:16 devstack sudo[95413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fb043593-6b30-4e39-b497-3f7897c25486
Sep 16 16:15:16 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:16 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c87a1981-54b5-48a7-a87f-8bcc2d8ca00e tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fb043593-6b30-4e39-b497-3f7897c25486" returned: 0 in 0.389s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c87a1981-54b5-48a7-a87f-8bcc2d8ca00e tempest-VolumesGetTest-201328229 None] Lock "cinder-quobyte-fb043593-6b30-4e39-b497-3f7897c25486" released by "delete_volume" :: held 1.116s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:16 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4f475a9e-b43d-4e86-9b91-300b4b313847 tempest-VolumesListTestJSON-380087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c63b6b6-86ea-4f2d-a032-04c511991f12" returned: 0 in 0.648s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4f475a9e-b43d-4e86-9b91-300b4b313847 tempest-VolumesListTestJSON-380087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c63b6b6-86ea-4f2d-a032-04c511991f12 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:16 devstack sudo[95420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c63b6b6-86ea-4f2d-a032-04c511991f12
Sep 16 16:15:16 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:16 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-c87a1981-54b5-48a7-a87f-8bcc2d8ca00e tempest-VolumesGetTest-201328229 None] Created reservations ['e8a6d522-f522-47e9-bddc-bb1332cc2dae', '28e3666d-9a3b-4dd0-8229-c9f964d1f024', '2c628416-e37e-4337-8e61-48808a61ad7e', 'adc71bc7-ce1d-40e9-b348-372382faf7e4'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:15:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c87a1981-54b5-48a7-a87f-8bcc2d8ca00e tempest-VolumesGetTest-201328229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c87a1981-54b5-48a7-a87f-8bcc2d8ca00e tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c87a1981-54b5-48a7-a87f-8bcc2d8ca00e tempest-VolumesGetTest-201328229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c87a1981-54b5-48a7-a87f-8bcc2d8ca00e tempest-VolumesGetTest-201328229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c87a1981-54b5-48a7-a87f-8bcc2d8ca00e tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c87a1981-54b5-48a7-a87f-8bcc2d8ca00e tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:17 devstack sudo[95422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:15:17 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:17 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4f475a9e-b43d-4e86-9b91-300b4b313847 tempest-VolumesListTestJSON-380087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c63b6b6-86ea-4f2d-a032-04c511991f12" returned: 0 in 0.599s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:17 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4f475a9e-b43d-4e86-9b91-300b4b313847 tempest-VolumesListTestJSON-380087 None] Lock "cinder-quobyte-1c63b6b6-86ea-4f2d-a032-04c511991f12" released by "delete_volume" :: held 1.348s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c87a1981-54b5-48a7-a87f-8bcc2d8ca00e tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.376s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:17 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-c87a1981-54b5-48a7-a87f-8bcc2d8ca00e tempest-VolumesGetTest-201328229 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:15:17 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c87a1981-54b5-48a7-a87f-8bcc2d8ca00e tempest-VolumesGetTest-201328229 None] Deleted volume successfully.
Sep 16 16:15:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c87a1981-54b5-48a7-a87f-8bcc2d8ca00e tempest-VolumesGetTest-201328229 None] Lock "cinder-fb043593-6b30-4e39-b497-3f7897c25486-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:17 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-4f475a9e-b43d-4e86-9b91-300b4b313847 tempest-VolumesListTestJSON-380087 None] Created reservations ['a4bd8411-1302-4a4b-a4a0-093f23c8e518', '57487d8a-8c54-4059-a15c-fcccb546e333', '70b2fdeb-6f34-4528-873c-b85fcb7cfeb8', '6e306c1d-3015-47dc-9581-b0dc31288b62'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:15:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4f475a9e-b43d-4e86-9b91-300b4b313847 tempest-VolumesListTestJSON-380087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4f475a9e-b43d-4e86-9b91-300b4b313847 tempest-VolumesListTestJSON-380087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4f475a9e-b43d-4e86-9b91-300b4b313847 tempest-VolumesListTestJSON-380087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4f475a9e-b43d-4e86-9b91-300b4b313847 tempest-VolumesListTestJSON-380087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4f475a9e-b43d-4e86-9b91-300b4b313847 tempest-VolumesListTestJSON-380087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4f475a9e-b43d-4e86-9b91-300b4b313847 tempest-VolumesListTestJSON-380087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:17 devstack sudo[95435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:15:17 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3d34850b-9ef9-40a5-b38f-382715f72b3a tempest-VolumesGetTest-201328229 None] Acquiring lock "cinder-dbdb05a8-f736-416d-9ddc-735e29ef8340-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3d34850b-9ef9-40a5-b38f-382715f72b3a tempest-VolumesGetTest-201328229 None] Lock "cinder-dbdb05a8-f736-416d-9ddc-735e29ef8340-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3d34850b-9ef9-40a5-b38f-382715f72b3a tempest-VolumesGetTest-201328229 None] Acquiring lock "cinder-quobyte-dbdb05a8-f736-416d-9ddc-735e29ef8340" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3d34850b-9ef9-40a5-b38f-382715f72b3a tempest-VolumesGetTest-201328229 None] Lock "cinder-quobyte-dbdb05a8-f736-416d-9ddc-735e29ef8340" acquired by "delete_volume" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:18 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[831e534f-3244-4043-8ae7-e8e0c136618a]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3d34850b-9ef9-40a5-b38f-382715f72b3a tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:18 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4f475a9e-b43d-4e86-9b91-300b4b313847 tempest-VolumesListTestJSON-380087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.416s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:18 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4f475a9e-b43d-4e86-9b91-300b4b313847 tempest-VolumesListTestJSON-380087 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:15:18 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-4f475a9e-b43d-4e86-9b91-300b4b313847 tempest-VolumesListTestJSON-380087 None] Deleted volume successfully.
Sep 16 16:15:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4f475a9e-b43d-4e86-9b91-300b4b313847 tempest-VolumesListTestJSON-380087 None] Lock "cinder-1c63b6b6-86ea-4f2d-a032-04c511991f12-delete_volume" released by "delete_volume" :: held 2.264s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:18 devstack sudo[95446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340
Sep 16 16:15:18 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d8b69d8c-914f-47cd-b1d1-a874fa324d89 tempest-VolumesListTestJSON-380087 None] Acquiring lock "cinder-d4995867-d52d-4fd3-b2b3-47d7c99b8011-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d8b69d8c-914f-47cd-b1d1-a874fa324d89 tempest-VolumesListTestJSON-380087 None] Lock "cinder-d4995867-d52d-4fd3-b2b3-47d7c99b8011-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d8b69d8c-914f-47cd-b1d1-a874fa324d89 tempest-VolumesListTestJSON-380087 None] Acquiring lock "cinder-quobyte-d4995867-d52d-4fd3-b2b3-47d7c99b8011" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d8b69d8c-914f-47cd-b1d1-a874fa324d89 tempest-VolumesListTestJSON-380087 None] Lock "cinder-quobyte-d4995867-d52d-4fd3-b2b3-47d7c99b8011" acquired by "delete_volume" :: waited 0.022s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:18 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[91189dba-6a46-4477-a996-05504a798a7b]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d8b69d8c-914f-47cd-b1d1-a874fa324d89 tempest-VolumesListTestJSON-380087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d4995867-d52d-4fd3-b2b3-47d7c99b8011 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:18 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3d34850b-9ef9-40a5-b38f-382715f72b3a tempest-VolumesGetTest-201328229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340" returned: 0 in 0.529s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3d34850b-9ef9-40a5-b38f-382715f72b3a tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:18 devstack sudo[95458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340
Sep 16 16:15:18 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:18 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-c03650d2-d081-4599-8eb8-79e1777c9625 req-626fc21c-2671-4c74-bc81-e88a3c473db8 tempest-AttachVolumeTestJSON-1114470276 None] Terminate volume connection completed successfully.
Sep 16 16:15:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-c03650d2-d081-4599-8eb8-79e1777c9625 req-626fc21c-2671-4c74-bc81-e88a3c473db8 tempest-AttachVolumeTestJSON-1114470276 None] Deleting attachment b31ff000-28f7-4777-b6f5-fbf45a3a561c. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:15:18 devstack sudo[95457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d4995867-d52d-4fd3-b2b3-47d7c99b8011
Sep 16 16:15:18 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:19 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3d34850b-9ef9-40a5-b38f-382715f72b3a tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dbdb05a8-f736-416d-9ddc-735e29ef8340" returned: 0 in 0.420s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3d34850b-9ef9-40a5-b38f-382715f72b3a tempest-VolumesGetTest-201328229 None] Lock "cinder-quobyte-dbdb05a8-f736-416d-9ddc-735e29ef8340" released by "delete_volume" :: held 1.098s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:19 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d8b69d8c-914f-47cd-b1d1-a874fa324d89 tempest-VolumesListTestJSON-380087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d4995867-d52d-4fd3-b2b3-47d7c99b8011" returned: 0 in 0.525s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d8b69d8c-914f-47cd-b1d1-a874fa324d89 tempest-VolumesListTestJSON-380087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d4995867-d52d-4fd3-b2b3-47d7c99b8011 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-3d34850b-9ef9-40a5-b38f-382715f72b3a tempest-VolumesGetTest-201328229 None] Created reservations ['37b42677-3cb2-448d-a4c0-078cbd417ae2', '77e324f2-7319-4e2f-899a-600f01a79c3c', '7367f46e-9cf5-484a-a8e1-4e44e61e599f', '2c7bbe75-fa60-4548-b4b2-ab9a2cfe67a3'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:15:19 devstack sudo[95465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d4995867-d52d-4fd3-b2b3-47d7c99b8011
Sep 16 16:15:19 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3d34850b-9ef9-40a5-b38f-382715f72b3a tempest-VolumesGetTest-201328229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3d34850b-9ef9-40a5-b38f-382715f72b3a tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3d34850b-9ef9-40a5-b38f-382715f72b3a tempest-VolumesGetTest-201328229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3d34850b-9ef9-40a5-b38f-382715f72b3a tempest-VolumesGetTest-201328229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3d34850b-9ef9-40a5-b38f-382715f72b3a tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3d34850b-9ef9-40a5-b38f-382715f72b3a tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:19 devstack sudo[95467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:15:19 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:19 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d8b69d8c-914f-47cd-b1d1-a874fa324d89 tempest-VolumesListTestJSON-380087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d4995867-d52d-4fd3-b2b3-47d7c99b8011" returned: 0 in 0.332s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d8b69d8c-914f-47cd-b1d1-a874fa324d89 tempest-VolumesListTestJSON-380087 None] Lock "cinder-quobyte-d4995867-d52d-4fd3-b2b3-47d7c99b8011" released by "delete_volume" :: held 0.919s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-d8b69d8c-914f-47cd-b1d1-a874fa324d89 tempest-VolumesListTestJSON-380087 None] Created reservations ['8194751c-2efc-4dd2-ba40-9add1c1d689a', 'ab65e4e1-ba7c-443f-bff8-2e5e9d465033', 'ed9d6073-85e2-4751-aef4-1f5eca3a577e', '31f8a4d1-e36f-4a54-8924-c92a79841314'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:15:19 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3d34850b-9ef9-40a5-b38f-382715f72b3a tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.357s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-3d34850b-9ef9-40a5-b38f-382715f72b3a tempest-VolumesGetTest-201328229 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:15:19 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-3d34850b-9ef9-40a5-b38f-382715f72b3a tempest-VolumesGetTest-201328229 None] Deleted volume successfully.
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3d34850b-9ef9-40a5-b38f-382715f72b3a tempest-VolumesGetTest-201328229 None] Lock "cinder-dbdb05a8-f736-416d-9ddc-735e29ef8340-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d8b69d8c-914f-47cd-b1d1-a874fa324d89 tempest-VolumesListTestJSON-380087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d8b69d8c-914f-47cd-b1d1-a874fa324d89 tempest-VolumesListTestJSON-380087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d8b69d8c-914f-47cd-b1d1-a874fa324d89 tempest-VolumesListTestJSON-380087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d8b69d8c-914f-47cd-b1d1-a874fa324d89 tempest-VolumesListTestJSON-380087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d8b69d8c-914f-47cd-b1d1-a874fa324d89 tempest-VolumesListTestJSON-380087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d8b69d8c-914f-47cd-b1d1-a874fa324d89 tempest-VolumesListTestJSON-380087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:19 devstack sudo[95472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:15:19 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:20 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d8b69d8c-914f-47cd-b1d1-a874fa324d89 tempest-VolumesListTestJSON-380087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.355s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:20 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-d8b69d8c-914f-47cd-b1d1-a874fa324d89 tempest-VolumesListTestJSON-380087 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:15:20 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-d8b69d8c-914f-47cd-b1d1-a874fa324d89 tempest-VolumesListTestJSON-380087 None] Deleted volume successfully.
Sep 16 16:15:20 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d8b69d8c-914f-47cd-b1d1-a874fa324d89 tempest-VolumesListTestJSON-380087 None] Lock "cinder-d4995867-d52d-4fd3-b2b3-47d7c99b8011-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:21 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:15:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Flow 'volume_create_manager' (b2ad29f5-b9dd-48e4-836f-d0c74c95cd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aadffa5a-b118-40e8-9762-652d9197a973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aadffa5a-b118-40e8-9762-652d9197a973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-383518331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb9106e5-993d-4ff5-a4d6-3e4cd9402903,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='88b4d3e35aa8409c95706e74c9a88f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:21Z,use_quota=True,user_id='ae3fc78098fe4c0899f05371fb451101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c82eb0e1-b29b-4137-83bb-fc1ba96d9126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c82eb0e1-b29b-4137-83bb-fc1ba96d9126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75751e79-ee12-4948-96a0-977161d31b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:21 devstack cinder-volume[86165]: DEBUG cinder.image.glance [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Creating Keystone auth plugin from conf {{(pid=86165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 16:15:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75751e79-ee12-4948-96a0-977161d31b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eb9106e5-993d-4ff5-a4d6-3e4cd9402903', 'volume_name': 'volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903', 'volume_size': 1, 'image_id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '896515a0bbf44034a5d624f4b911b6d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 2, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f1ed024-e14f-4371-8a39-a1d416ee528e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e4c015e80>}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c99f74-54c9-43bd-82cc-8571f9362742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c99f74-54c9-43bd-82cc-8571f9362742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0676602-aa09-4de2-bdb1-9240072fd491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:22 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Volume eb9106e5-993d-4ff5-a4d6-3e4cd9402903: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903', 'volume_size': 1, 'image_id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '896515a0bbf44034a5d624f4b911b6d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 2, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f1ed024-e14f-4371-8a39-a1d416ee528e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e4c015e80>}
Sep 16 16:15:22 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Trying to clone eb9106e5-993d-4ff5-a4d6-3e4cd9402903 from image 4f1ed024-e14f-4371-8a39-a1d416ee528e at location (None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}]). {{(pid=86165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 16:15:23 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_i5qicvazdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 16:15:23 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Image download 20.69 MB at 20.69 MB/s
Sep 16 16:15:23 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edc664d-4b67-4814-a2d5-a3c95401a45b]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_i5qicvazdevstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:23 devstack sudo[95552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_i5qicvazdevstack@QuobyteHD
Sep 16 16:15:23 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:24 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_i5qicvazdevstack@QuobyteHD" returned: 0 in 0.724s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:24 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Temporary image 4f1ed024-e14f-4371-8a39-a1d416ee528e is fetched for user ae3fc78098fe4c0899f05371fb451101. {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 16:15:24 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca59e81-f45b-4868-8bcd-0bf1b04b45e5]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_i5qicvazdevstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:24 devstack sudo[95574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_i5qicvazdevstack@QuobyteHD
Sep 16 16:15:24 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:25 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_i5qicvazdevstack@QuobyteHD" returned: 0 in 0.902s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-383518331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb9106e5-993d-4ff5-a4d6-3e4cd9402903,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='88b4d3e35aa8409c95706e74c9a88f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:21Z,use_quota=True,user_id='ae3fc78098fe4c0899f05371fb451101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Creating volume eb9106e5-993d-4ff5-a4d6-3e4cd9402903 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:15:25 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:25 devstack sudo[95594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903 1073741824
Sep 16 16:15:25 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Flow 'volume_create_manager' (9fc3f209-8d9a-41a8-8a61-7b001eef480d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce54fcb2-d4bb-443f-81f6-2b79f4d6495b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce54fcb2-d4bb-443f-81f6-2b79f4d6495b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1585998190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9f62c0-a6bb-48d2-8cf3-583b998dd277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f841a1e80942487fb87b9d50198ca525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:25Z,use_quota=True,user_id='42a6c8f96a654b4587cf55ff47661d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b127a6b-b8a6-4042-aef3-b02775366e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b127a6b-b8a6-4042-aef3-b02775366e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba4d91f-6137-4d10-b3d6-8fe3443aebe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba4d91f-6137-4d10-b3d6-8fe3443aebe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b9f62c0-a6bb-48d2-8cf3-583b998dd277', 'volume_name': 'volume-9b9f62c0-a6bb-48d2-8cf3-583b998dd277', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0777ef26-8f40-48f0-a670-b586da76bb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0777ef26-8f40-48f0-a670-b586da76bb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8846c796-6db7-46bf-a129-184b54fe6349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:25 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Volume 9b9f62c0-a6bb-48d2-8cf3-583b998dd277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b9f62c0-a6bb-48d2-8cf3-583b998dd277', 'volume_size': 1}
Sep 16 16:15:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:26 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903 1073741824" returned: 0 in 1.226s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:26 devstack sudo[95654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903
Sep 16 16:15:26 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:27 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903" returned: 0 in 0.544s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:15:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.558s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1585998190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9f62c0-a6bb-48d2-8cf3-583b998dd277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f841a1e80942487fb87b9d50198ca525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:25Z,use_quota=True,user_id='42a6c8f96a654b4587cf55ff47661d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:15:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Creating volume 9b9f62c0-a6bb-48d2-8cf3-583b998dd277 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:15:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:15:27 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:15:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b9f62c0-a6bb-48d2-8cf3-583b998dd277 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:27 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Attempting download of 4f1ed024-e14f-4371-8a39-a1d416ee528e ((None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}])) to volume eb9106e5-993d-4ff5-a4d6-3e4cd9402903. {{(pid=86165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 16:15:27 devstack sudo[95663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b9f62c0-a6bb-48d2-8cf3-583b998dd277 1073741824
Sep 16 16:15:27 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:27 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca9cb64-f968-42b4-a7df-646807078ec7]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_abvy7mgd {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:27 devstack sudo[95665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_abvy7mgd
Sep 16 16:15:27 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:28 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_abvy7mgd" returned: 0 in 0.617s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_abvy7mgd {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:28 devstack sudo[95674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_abvy7mgd
Sep 16 16:15:28 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:28 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b9f62c0-a6bb-48d2-8cf3-583b998dd277 1073741824" returned: 0 in 0.985s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b9f62c0-a6bb-48d2-8cf3-583b998dd277 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:28 devstack sudo[95676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b9f62c0-a6bb-48d2-8cf3-583b998dd277
Sep 16 16:15:28 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:28 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_abvy7mgd" returned: 1 in 0.474s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_abvy7mgd' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:15:28 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[95405580-7dca-489d-837e-231426814124]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_i5qicvazdevstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:28 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b9f62c0-a6bb-48d2-8cf3-583b998dd277" returned: 0 in 0.455s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:28 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:15:28 devstack sudo[95680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_i5qicvazdevstack@QuobyteHD
Sep 16 16:15:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:28 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:28 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8846c796-6db7-46bf-a129-184b54fe6349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b9f62c0-a6bb-48d2-8cf3-583b998dd277', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:28 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab21a2d2-9c09-4d62-a3f9-d1fe46a8af07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:28 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Volume volume-9b9f62c0-a6bb-48d2-8cf3-583b998dd277 (9b9f62c0-a6bb-48d2-8cf3-583b998dd277): created successfully
Sep 16 16:15:28 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab21a2d2-9c09-4d62-a3f9-d1fe46a8af07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Flow 'volume_create_manager' (9fc3f209-8d9a-41a8-8a61-7b001eef480d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:29 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-403ccde1-8331-47fe-93c5-7469730f07a0 tempest-VolumesActionsTest-1927676535 None] Created volume successfully.
Sep 16 16:15:29 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_i5qicvazdevstack@QuobyteHD" returned: 0 in 0.680s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:29 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] 4f1ed024-e14f-4371-8a39-a1d416ee528e was qcow2, converting to qcow2 {{(pid=86165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 16:15:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_i5qicvazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:29 devstack sudo[95688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_i5qicvazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903
Sep 16 16:15:29 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0c5e7637-bff3-4b72-93de-cdbc6546c570 tempest-VolumesActionsTest-1927676535 None] Acquiring lock "cinder-9b9f62c0-a6bb-48d2-8cf3-583b998dd277" by "attach_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0c5e7637-bff3-4b72-93de-cdbc6546c570 tempest-VolumesActionsTest-1927676535 None] Lock "cinder-9b9f62c0-a6bb-48d2-8cf3-583b998dd277" acquired by "attach_volume" :: waited 0.037s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:29 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-0c5e7637-bff3-4b72-93de-cdbc6546c570 tempest-VolumesActionsTest-1927676535 None] Attaching volume 9b9f62c0-a6bb-48d2-8cf3-583b998dd277 to instance b280a58c-fd95-44aa-98d3-997a584f7921 at mountpoint /dev/vdb on host None.
Sep 16 16:15:30 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-0c5e7637-bff3-4b72-93de-cdbc6546c570 tempest-VolumesActionsTest-1927676535 None] Attach volume completed successfully.
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0c5e7637-bff3-4b72-93de-cdbc6546c570 tempest-VolumesActionsTest-1927676535 None] Lock "cinder-9b9f62c0-a6bb-48d2-8cf3-583b998dd277" released by "attach_volume" :: held 0.237s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Flow 'volume_create_manager' (5f0f8a4a-b452-4869-be6e-8abe168ebf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275c9a11-094e-440a-a21f-4ad915753378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275c9a11-094e-440a-a21f-4ad915753378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-376871087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c3affd4-48d7-408b-9b6c-294a56683414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dbc03b109c843d298f334ee27933e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:30Z,use_quota=True,user_id='28669c159c5b4a9980ef4d6ba2a107db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622c28c6-30a6-4188-8ce4-ca95ee43d18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622c28c6-30a6-4188-8ce4-ca95ee43d18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b776d4-f67f-4a37-8b40-7b8bf055486b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b776d4-f67f-4a37-8b40-7b8bf055486b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c3affd4-48d7-408b-9b6c-294a56683414', 'volume_name': 'volume-3c3affd4-48d7-408b-9b6c-294a56683414', 'volume_size': 2}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4847793-5e43-4ce2-8dcb-b9c71510d3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4847793-5e43-4ce2-8dcb-b9c71510d3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50edec85-3a56-4a9c-b05f-63f98bb8426b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:30 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Volume 3c3affd4-48d7-408b-9b6c-294a56683414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c3affd4-48d7-408b-9b6c-294a56683414', 'volume_size': 2}
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-376871087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c3affd4-48d7-408b-9b6c-294a56683414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dbc03b109c843d298f334ee27933e08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:30Z,use_quota=True,user_id='28669c159c5b4a9980ef4d6ba2a107db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Creating volume 3c3affd4-48d7-408b-9b6c-294a56683414 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:15:30 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:15:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414 2147483648 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:30 devstack sudo[95696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414 2147483648
Sep 16 16:15:30 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:31 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-0d6ca3e3-dd92-44b2-83f0-4079836c2f47 tempest-VolumesActionsTest-2124306866 None] Terminate volume connection completed successfully.
Sep 16 16:15:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0d6ca3e3-dd92-44b2-83f0-4079836c2f47 tempest-VolumesActionsTest-2124306866 None] Acquiring lock "cinder-9b9f62c0-a6bb-48d2-8cf3-583b998dd277-detach_volume" by "detach_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0d6ca3e3-dd92-44b2-83f0-4079836c2f47 tempest-VolumesActionsTest-2124306866 None] Lock "cinder-9b9f62c0-a6bb-48d2-8cf3-583b998dd277-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:31 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-0d6ca3e3-dd92-44b2-83f0-4079836c2f47 tempest-VolumesActionsTest-2124306866 None] Detaching volume 9b9f62c0-a6bb-48d2-8cf3-583b998dd277 from instance b280a58c-fd95-44aa-98d3-997a584f7921.
Sep 16 16:15:31 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-0d6ca3e3-dd92-44b2-83f0-4079836c2f47 tempest-VolumesActionsTest-2124306866 None] Detach volume completed successfully.
Sep 16 16:15:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0d6ca3e3-dd92-44b2-83f0-4079836c2f47 tempest-VolumesActionsTest-2124306866 None] Lock "cinder-9b9f62c0-a6bb-48d2-8cf3-583b998dd277-detach_volume" released by "detach_volume" :: held 0.138s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:31 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414 2147483648" returned: 0 in 1.008s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:31 devstack sudo[95703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414
Sep 16 16:15:31 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4db899a7-2fde-4c84-af16-fd513a32412a tempest-VolumesActionsTest-1927676535 None] Acquiring lock "cinder-9b9f62c0-a6bb-48d2-8cf3-583b998dd277-detach_volume" by "detach_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4db899a7-2fde-4c84-af16-fd513a32412a tempest-VolumesActionsTest-1927676535 None] Lock "cinder-9b9f62c0-a6bb-48d2-8cf3-583b998dd277-detach_volume" acquired by "detach_volume" :: waited 0.061s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:31 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-4db899a7-2fde-4c84-af16-fd513a32412a tempest-VolumesActionsTest-1927676535 None] Volume detach called, but volume not attached.
Sep 16 16:15:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4db899a7-2fde-4c84-af16-fd513a32412a tempest-VolumesActionsTest-1927676535 None] Lock "cinder-9b9f62c0-a6bb-48d2-8cf3-583b998dd277-detach_volume" released by "detach_volume" :: held 0.054s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:32 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414" returned: 0 in 0.335s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:15:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50edec85-3a56-4a9c-b05f-63f98bb8426b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c3affd4-48d7-408b-9b6c-294a56683414', 'volume_size': 2}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ecf592-6127-4946-9c2c-a178b14709f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:32 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Volume volume-3c3affd4-48d7-408b-9b6c-294a56683414 (3c3affd4-48d7-408b-9b6c-294a56683414): created successfully
Sep 16 16:15:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ecf592-6127-4946-9c2c-a178b14709f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Flow 'volume_create_manager' (5f0f8a4a-b452-4869-be6e-8abe168ebf26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:32 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-161664dd-7cd7-40f7-b34d-0dff227a020a tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Created volume successfully.
Sep 16 16:15:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c14fd153-51fb-4b2f-91ed-093f7cf0944d tempest-VolumesActionsTest-1927676535 None] Acquiring lock "cinder-9b9f62c0-a6bb-48d2-8cf3-583b998dd277-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c14fd153-51fb-4b2f-91ed-093f7cf0944d tempest-VolumesActionsTest-1927676535 None] Lock "cinder-9b9f62c0-a6bb-48d2-8cf3-583b998dd277-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c14fd153-51fb-4b2f-91ed-093f7cf0944d tempest-VolumesActionsTest-1927676535 None] Acquiring lock "cinder-quobyte-9b9f62c0-a6bb-48d2-8cf3-583b998dd277" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c14fd153-51fb-4b2f-91ed-093f7cf0944d tempest-VolumesActionsTest-1927676535 None] Lock "cinder-quobyte-9b9f62c0-a6bb-48d2-8cf3-583b998dd277" acquired by "delete_volume" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:32 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4ef291-f07e-427d-9901-362152f1b8ea]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c14fd153-51fb-4b2f-91ed-093f7cf0944d tempest-VolumesActionsTest-1927676535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b9f62c0-a6bb-48d2-8cf3-583b998dd277 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:32 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_i5qicvazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903" returned: 0 in 3.256s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:32 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_i5qicvazdevstack@QuobyteHD, size 112.00 MB, duration 3.26 sec, destination /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903 {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:15:32 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Converted 112.00 MB image at 34.38 MB/s
Sep 16 16:15:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:32 devstack sudo[95707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903 1G
Sep 16 16:15:32 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:32 devstack sudo[95706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b9f62c0-a6bb-48d2-8cf3-583b998dd277
Sep 16 16:15:32 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f6607b4b-2c1b-4cba-8fe4-ac0fc2f57e52 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f6607b4b-2c1b-4cba-8fe4-ac0fc2f57e52 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-f6607b4b-2c1b-4cba-8fe4-ac0fc2f57e52 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Creating offline snapshot 333adfb0-aa43-4ff0-8060-91d733aca0c5 of volume 3c3affd4-48d7-408b-9b6c-294a56683414 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[592cd36a-9668-4e39-80a0-5098a98ae309]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f6607b4b-2c1b-4cba-8fe4-ac0fc2f57e52 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:33 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c14fd153-51fb-4b2f-91ed-093f7cf0944d tempest-VolumesActionsTest-1927676535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b9f62c0-a6bb-48d2-8cf3-583b998dd277" returned: 0 in 0.681s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c14fd153-51fb-4b2f-91ed-093f7cf0944d tempest-VolumesActionsTest-1927676535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b9f62c0-a6bb-48d2-8cf3-583b998dd277 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:33 devstack sudo[95717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b9f62c0-a6bb-48d2-8cf3-583b998dd277
Sep 16 16:15:33 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:33 devstack sudo[95712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414
Sep 16 16:15:33 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:33 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903 1G" returned: 0 in 0.737s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Downloaded image 4f1ed024-e14f-4371-8a39-a1d416ee528e ((None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}])) to volume eb9106e5-993d-4ff5-a4d6-3e4cd9402903 successfully. {{(pid=86165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Temporary image 4f1ed024-e14f-4371-8a39-a1d416ee528e for user ae3fc78098fe4c0899f05371fb451101 is deleted. {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Marking volume eb9106e5-993d-4ff5-a4d6-3e4cd9402903 as bootable. {{(pid=86165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Copying metadata from image 4f1ed024-e14f-4371-8a39-a1d416ee528e to eb9106e5-993d-4ff5-a4d6-3e4cd9402903. {{(pid=86165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Creating volume glance metadata for volume eb9106e5-993d-4ff5-a4d6-3e4cd9402903 backed by image 4f1ed024-e14f-4371-8a39-a1d416ee528e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0676602-aa09-4de2-bdb1-9240072fd491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903', 'volume_size': 1, 'image_id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '896515a0bbf44034a5d624f4b911b6d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 2, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f1ed024-e14f-4371-8a39-a1d416ee528e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e4c015e80>}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0af453-0e30-463b-8738-4182095b06d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:33 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Volume volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903 (eb9106e5-993d-4ff5-a4d6-3e4cd9402903): created successfully
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0af453-0e30-463b-8738-4182095b06d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Flow 'volume_create_manager' (b2ad29f5-b9dd-48e4-836f-d0c74c95cd42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:33 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-267fb9ee-4919-4e12-8ca5-4c3572729de2 tempest-VolumesGetTest-201328229 None] Created volume successfully.
Sep 16 16:15:33 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c14fd153-51fb-4b2f-91ed-093f7cf0944d tempest-VolumesActionsTest-1927676535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b9f62c0-a6bb-48d2-8cf3-583b998dd277" returned: 0 in 0.414s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c14fd153-51fb-4b2f-91ed-093f7cf0944d tempest-VolumesActionsTest-1927676535 None] Lock "cinder-quobyte-9b9f62c0-a6bb-48d2-8cf3-583b998dd277" released by "delete_volume" :: held 1.162s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-c14fd153-51fb-4b2f-91ed-093f7cf0944d tempest-VolumesActionsTest-1927676535 None] Created reservations ['81a6f887-6378-45d8-8f7a-f2c73016b3a2', '58491c86-1055-4a0a-b0c3-9d90f702fe0b', '1750c500-afd1-4d5e-87a9-54ca8aaeea81', '06feb3c3-7edf-42c6-868a-f14f5b2bedc7'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:15:33 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f6607b4b-2c1b-4cba-8fe4-ac0fc2f57e52 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414" returned: 0 in 0.659s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f6607b4b-2c1b-4cba-8fe4-ac0fc2f57e52 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.333adfb0-aa43-4ff0-8060-91d733aca0c5 2G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:33 devstack sudo[95725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.333adfb0-aa43-4ff0-8060-91d733aca0c5 2G
Sep 16 16:15:33 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c14fd153-51fb-4b2f-91ed-093f7cf0944d tempest-VolumesActionsTest-1927676535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c14fd153-51fb-4b2f-91ed-093f7cf0944d tempest-VolumesActionsTest-1927676535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c14fd153-51fb-4b2f-91ed-093f7cf0944d tempest-VolumesActionsTest-1927676535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c14fd153-51fb-4b2f-91ed-093f7cf0944d tempest-VolumesActionsTest-1927676535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c14fd153-51fb-4b2f-91ed-093f7cf0944d tempest-VolumesActionsTest-1927676535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c14fd153-51fb-4b2f-91ed-093f7cf0944d tempest-VolumesActionsTest-1927676535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:33 devstack sudo[95727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:15:33 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:34 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c14fd153-51fb-4b2f-91ed-093f7cf0944d tempest-VolumesActionsTest-1927676535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.376s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:34 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-c14fd153-51fb-4b2f-91ed-093f7cf0944d tempest-VolumesActionsTest-1927676535 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:15:34 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c14fd153-51fb-4b2f-91ed-093f7cf0944d tempest-VolumesActionsTest-1927676535 None] Deleted volume successfully.
Sep 16 16:15:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c14fd153-51fb-4b2f-91ed-093f7cf0944d tempest-VolumesActionsTest-1927676535 None] Lock "cinder-9b9f62c0-a6bb-48d2-8cf3-583b998dd277-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:34 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f6607b4b-2c1b-4cba-8fe4-ac0fc2f57e52 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.333adfb0-aa43-4ff0-8060-91d733aca0c5 2G" returned: 0 in 0.632s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f6607b4b-2c1b-4cba-8fe4-ac0fc2f57e52 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c3affd4-48d7-408b-9b6c-294a56683414 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.333adfb0-aa43-4ff0-8060-91d733aca0c5 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:34 devstack sudo[95734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c3affd4-48d7-408b-9b6c-294a56683414 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.333adfb0-aa43-4ff0-8060-91d733aca0c5
Sep 16 16:15:34 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:34 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f6607b4b-2c1b-4cba-8fe4-ac0fc2f57e52 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c3affd4-48d7-408b-9b6c-294a56683414 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.333adfb0-aa43-4ff0-8060-91d733aca0c5" returned: 0 in 0.356s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:34 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-f6607b4b-2c1b-4cba-8fe4-ac0fc2f57e52 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.333adfb0-aa43-4ff0-8060-91d733aca0c5 is being set with open permissions: ugo+rw
Sep 16 16:15:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f6607b4b-2c1b-4cba-8fe4-ac0fc2f57e52 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.333adfb0-aa43-4ff0-8060-91d733aca0c5 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:34 devstack sudo[95740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.333adfb0-aa43-4ff0-8060-91d733aca0c5
Sep 16 16:15:34 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:35 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f6607b4b-2c1b-4cba-8fe4-ac0fc2f57e52 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.333adfb0-aa43-4ff0-8060-91d733aca0c5" returned: 0 in 0.368s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f6607b4b-2c1b-4cba-8fe4-ac0fc2f57e52 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:35 devstack sudo[95744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.info
Sep 16 16:15:35 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:35 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:15:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Flow 'volume_create_manager' (b0120d9e-e157-48ec-a317-c8d8c5932775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8dac1f-73ff-46de-b1b7-744bbf5a4296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8dac1f-73ff-46de-b1b7-744bbf5a4296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:15:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-483724280',display_name='tempest-VolumesGetTest-Volume-113197836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e7aaef9-07fa-49cf-b87f-49b380969500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88b4d3e35aa8409c95706e74c9a88f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:35Z,use_quota=True,user_id='ae3fc78098fe4c0899f05371fb451101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52f8245-221b-480b-b0e8-76173c40aeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52f8245-221b-480b-b0e8-76173c40aeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7472a0-f121-4fe4-bcf7-4d41ed347a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7472a0-f121-4fe4-bcf7-4d41ed347a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e7aaef9-07fa-49cf-b87f-49b380969500', 'volume_name': 'volume-2e7aaef9-07fa-49cf-b87f-49b380969500', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053af49c-818c-42f0-9f3d-ba7870dd4774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053af49c-818c-42f0-9f3d-ba7870dd4774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e92b9e-cd51-4310-883f-12227233325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:35 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Volume 2e7aaef9-07fa-49cf-b87f-49b380969500: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e7aaef9-07fa-49cf-b87f-49b380969500', 'volume_size': 1}
Sep 16 16:15:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:35 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f6607b4b-2c1b-4cba-8fe4-ac0fc2f57e52 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.info" returned: 0 in 0.438s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:35 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-f6607b4b-2c1b-4cba-8fe4-ac0fc2f57e52 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.info is being set with open permissions: ugo+rw
Sep 16 16:15:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f6607b4b-2c1b-4cba-8fe4-ac0fc2f57e52 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:35 devstack sudo[95757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.info
Sep 16 16:15:35 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:36 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f6607b4b-2c1b-4cba-8fe4-ac0fc2f57e52 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.info" returned: 0 in 0.424s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f6607b4b-2c1b-4cba-8fe4-ac0fc2f57e52 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.105s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.526s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:15:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-483724280',display_name='tempest-VolumesGetTest-Volume-113197836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e7aaef9-07fa-49cf-b87f-49b380969500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88b4d3e35aa8409c95706e74c9a88f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:35Z,use_quota=True,user_id='ae3fc78098fe4c0899f05371fb451101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:15:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Creating volume 2e7aaef9-07fa-49cf-b87f-49b380969500 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:15:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:15:36 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:15:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2e7aaef9-07fa-49cf-b87f-49b380969500 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:36 devstack sudo[95771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2e7aaef9-07fa-49cf-b87f-49b380969500 1073741824
Sep 16 16:15:36 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:36 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-f6607b4b-2c1b-4cba-8fe4-ac0fc2f57e52 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Create snapshot completed successfully
Sep 16 16:15:36 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2e7aaef9-07fa-49cf-b87f-49b380969500 1073741824" returned: 0 in 0.550s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2e7aaef9-07fa-49cf-b87f-49b380969500 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:36 devstack sudo[95777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2e7aaef9-07fa-49cf-b87f-49b380969500
Sep 16 16:15:36 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:37 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2e7aaef9-07fa-49cf-b87f-49b380969500" returned: 0 in 0.532s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:15:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e92b9e-cd51-4310-883f-12227233325f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e7aaef9-07fa-49cf-b87f-49b380969500', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (368f2c81-ee16-4796-b988-c1a186f39846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:37 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Volume volume-2e7aaef9-07fa-49cf-b87f-49b380969500 (2e7aaef9-07fa-49cf-b87f-49b380969500): created successfully
Sep 16 16:15:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (368f2c81-ee16-4796-b988-c1a186f39846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Flow 'volume_create_manager' (b0120d9e-e157-48ec-a317-c8d8c5932775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:37 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-62a03e11-f274-4514-825e-83c5eff62ff0 tempest-VolumesGetTest-201328229 None] Created volume successfully.
Sep 16 16:15:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-12fca01f-330f-41f6-b29c-5c095c8150b8 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Acquiring lock "cinder-333adfb0-aa43-4ff0-8060-91d733aca0c5-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-12fca01f-330f-41f6-b29c-5c095c8150b8 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Lock "cinder-333adfb0-aa43-4ff0-8060-91d733aca0c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-12fca01f-330f-41f6-b29c-5c095c8150b8 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Acquiring lock "cinder-quobyte-3c3affd4-48d7-408b-9b6c-294a56683414" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-12fca01f-330f-41f6-b29c-5c095c8150b8 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Lock "cinder-quobyte-3c3affd4-48d7-408b-9b6c-294a56683414" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-12fca01f-330f-41f6-b29c-5c095c8150b8 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Acquiring lock "cinder-quobyte-333adfb0-aa43-4ff0-8060-91d733aca0c5" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-12fca01f-330f-41f6-b29c-5c095c8150b8 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Lock "cinder-quobyte-333adfb0-aa43-4ff0-8060-91d733aca0c5" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-12fca01f-330f-41f6-b29c-5c095c8150b8 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Deleting offline snapshot 333adfb0-aa43-4ff0-8060-91d733aca0c5 of volume 3c3affd4-48d7-408b-9b6c-294a56683414 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:15:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-12fca01f-330f-41f6-b29c-5c095c8150b8 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] snapshot_file for this snap is: volume-3c3affd4-48d7-408b-9b6c-294a56683414.333adfb0-aa43-4ff0-8060-91d733aca0c5 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:15:37 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a178c30d-b3a2-4387-9ba1-d62b52b58d74]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-12fca01f-330f-41f6-b29c-5c095c8150b8 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.333adfb0-aa43-4ff0-8060-91d733aca0c5 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:37 devstack sudo[95783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.333adfb0-aa43-4ff0-8060-91d733aca0c5
Sep 16 16:15:37 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:37 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-12fca01f-330f-41f6-b29c-5c095c8150b8 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.333adfb0-aa43-4ff0-8060-91d733aca0c5" returned: 0 in 0.419s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-12fca01f-330f-41f6-b29c-5c095c8150b8 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c3affd4-48d7-408b-9b6c-294a56683414(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:15:38 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a75bed0-abd3-432c-8d4b-6e4d92299e70]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-12fca01f-330f-41f6-b29c-5c095c8150b8 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:38 devstack sudo[95788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414
Sep 16 16:15:38 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:38 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-12fca01f-330f-41f6-b29c-5c095c8150b8 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414" returned: 0 in 0.433s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-12fca01f-330f-41f6-b29c-5c095c8150b8 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.333adfb0-aa43-4ff0-8060-91d733aca0c5 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:38 devstack sudo[95793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.333adfb0-aa43-4ff0-8060-91d733aca0c5
Sep 16 16:15:38 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c8de24e0-5ac1-49bf-8748-3c0348b2e3f5 tempest-VolumesGetTest-201328229 None] Acquiring lock "cinder-2e7aaef9-07fa-49cf-b87f-49b380969500-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c8de24e0-5ac1-49bf-8748-3c0348b2e3f5 tempest-VolumesGetTest-201328229 None] Lock "cinder-2e7aaef9-07fa-49cf-b87f-49b380969500-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c8de24e0-5ac1-49bf-8748-3c0348b2e3f5 tempest-VolumesGetTest-201328229 None] Acquiring lock "cinder-quobyte-2e7aaef9-07fa-49cf-b87f-49b380969500" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c8de24e0-5ac1-49bf-8748-3c0348b2e3f5 tempest-VolumesGetTest-201328229 None] Lock "cinder-quobyte-2e7aaef9-07fa-49cf-b87f-49b380969500" acquired by "delete_volume" :: waited 0.027s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:38 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1096cb4f-39e0-40ab-9615-600b389e357b]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c8de24e0-5ac1-49bf-8748-3c0348b2e3f5 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2e7aaef9-07fa-49cf-b87f-49b380969500 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:39 devstack sudo[95798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2e7aaef9-07fa-49cf-b87f-49b380969500
Sep 16 16:15:39 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:39 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Flow 'volume_create_manager' (72265247-3a93-4a48-b121-6a3da0df0069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8983cf09-0355-4790-97f7-091086af7b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-12fca01f-330f-41f6-b29c-5c095c8150b8 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.333adfb0-aa43-4ff0-8060-91d733aca0c5" returned: 0 in 0.627s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-12fca01f-330f-41f6-b29c-5c095c8150b8 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.333adfb0-aa43-4ff0-8060-91d733aca0c5 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:39 devstack sudo[95800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.333adfb0-aa43-4ff0-8060-91d733aca0c5
Sep 16 16:15:39 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8983cf09-0355-4790-97f7-091086af7b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1656140765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117b735b-5592-4182-bee4-6fc9e00a8e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f841a1e80942487fb87b9d50198ca525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:39Z,use_quota=True,user_id='42a6c8f96a654b4587cf55ff47661d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4fd29aa-7ed0-4120-9f30-8545b10fb85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4fd29aa-7ed0-4120-9f30-8545b10fb85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb12339-45c8-447f-b4b0-f3c493eee8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb12339-45c8-447f-b4b0-f3c493eee8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '117b735b-5592-4182-bee4-6fc9e00a8e8e', 'volume_name': 'volume-117b735b-5592-4182-bee4-6fc9e00a8e8e', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f53a3d-84dd-433e-8de9-ec244a0f29d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f53a3d-84dd-433e-8de9-ec244a0f29d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b07a45-e3fd-422c-b67f-d1fa5f457488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:39 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Volume 117b735b-5592-4182-bee4-6fc9e00a8e8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-117b735b-5592-4182-bee4-6fc9e00a8e8e', 'volume_size': 1}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1656140765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117b735b-5592-4182-bee4-6fc9e00a8e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f841a1e80942487fb87b9d50198ca525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:39Z,use_quota=True,user_id='42a6c8f96a654b4587cf55ff47661d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Creating volume 117b735b-5592-4182-bee4-6fc9e00a8e8e {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:15:39 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117b735b-5592-4182-bee4-6fc9e00a8e8e 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:39 devstack sudo[95802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117b735b-5592-4182-bee4-6fc9e00a8e8e 1073741824
Sep 16 16:15:39 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:39 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-12fca01f-330f-41f6-b29c-5c095c8150b8 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414.333adfb0-aa43-4ff0-8060-91d733aca0c5" returned: 0 in 0.306s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:39 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c8de24e0-5ac1-49bf-8748-3c0348b2e3f5 tempest-VolumesGetTest-201328229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2e7aaef9-07fa-49cf-b87f-49b380969500" returned: 0 in 0.496s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c8de24e0-5ac1-49bf-8748-3c0348b2e3f5 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2e7aaef9-07fa-49cf-b87f-49b380969500 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:39 devstack sudo[95810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2e7aaef9-07fa-49cf-b87f-49b380969500
Sep 16 16:15:39 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-12fca01f-330f-41f6-b29c-5c095c8150b8 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Lock "cinder-quobyte-333adfb0-aa43-4ff0-8060-91d733aca0c5" released by "_delete_snapshot" :: held 1.942s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-12fca01f-330f-41f6-b29c-5c095c8150b8 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Lock "cinder-quobyte-3c3affd4-48d7-408b-9b6c-294a56683414" released by "delete_snapshot" :: held 1.991s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-12fca01f-330f-41f6-b29c-5c095c8150b8 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Created reservations ['8819705b-4f52-4e24-978c-1cc2d25907a7', 'ae7a6672-e578-4f81-8539-4065ff2502d3', '47e47edb-016d-459d-89fb-cf6e721853cb', '2ccf3c29-6a60-4828-9ef8-7046ab43e8fa'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:15:39 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-12fca01f-330f-41f6-b29c-5c095c8150b8 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Delete snapshot completed successfully.
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-12fca01f-330f-41f6-b29c-5c095c8150b8 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Lock "cinder-333adfb0-aa43-4ff0-8060-91d733aca0c5-delete_snapshot" released by "delete_snapshot" :: held 2.197s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:39 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117b735b-5592-4182-bee4-6fc9e00a8e8e 1073741824" returned: 0 in 0.624s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:39 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c8de24e0-5ac1-49bf-8748-3c0348b2e3f5 tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2e7aaef9-07fa-49cf-b87f-49b380969500" returned: 0 in 0.408s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-86ba52b2-bed5-40a8-9dc1-972fedc00ba9 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Acquiring lock "cinder-3c3affd4-48d7-408b-9b6c-294a56683414-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c8de24e0-5ac1-49bf-8748-3c0348b2e3f5 tempest-VolumesGetTest-201328229 None] Lock "cinder-quobyte-2e7aaef9-07fa-49cf-b87f-49b380969500" released by "delete_volume" :: held 0.982s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117b735b-5592-4182-bee4-6fc9e00a8e8e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-86ba52b2-bed5-40a8-9dc1-972fedc00ba9 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Lock "cinder-3c3affd4-48d7-408b-9b6c-294a56683414-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:39 devstack sudo[95817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117b735b-5592-4182-bee4-6fc9e00a8e8e
Sep 16 16:15:39 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-86ba52b2-bed5-40a8-9dc1-972fedc00ba9 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Acquiring lock "cinder-quobyte-3c3affd4-48d7-408b-9b6c-294a56683414" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-86ba52b2-bed5-40a8-9dc1-972fedc00ba9 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Lock "cinder-quobyte-3c3affd4-48d7-408b-9b6c-294a56683414" acquired by "delete_volume" :: waited 0.024s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-c8de24e0-5ac1-49bf-8748-3c0348b2e3f5 tempest-VolumesGetTest-201328229 None] Created reservations ['66cd8d42-a1fc-49e1-b078-be34851cb671', '345344f0-ab73-4b20-8a6f-09e312ed6c87', '09051011-3de8-4eec-91fa-934a8417c75a', '6dae0043-abe1-423d-847d-68894d158ead'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b68484-8108-4649-81fa-7104af30b9e2]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-86ba52b2-bed5-40a8-9dc1-972fedc00ba9 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c8de24e0-5ac1-49bf-8748-3c0348b2e3f5 tempest-VolumesGetTest-201328229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c8de24e0-5ac1-49bf-8748-3c0348b2e3f5 tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c8de24e0-5ac1-49bf-8748-3c0348b2e3f5 tempest-VolumesGetTest-201328229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c8de24e0-5ac1-49bf-8748-3c0348b2e3f5 tempest-VolumesGetTest-201328229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c8de24e0-5ac1-49bf-8748-3c0348b2e3f5 tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c8de24e0-5ac1-49bf-8748-3c0348b2e3f5 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:40 devstack sudo[95821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:15:40 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:40 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117b735b-5592-4182-bee4-6fc9e00a8e8e" returned: 0 in 0.342s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b07a45-e3fd-422c-b67f-d1fa5f457488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117b735b-5592-4182-bee4-6fc9e00a8e8e', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:40 devstack sudo[95819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414
Sep 16 16:15:40 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a36c6476-385f-4cb9-a0bb-09d4a65e9a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:40 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Volume volume-117b735b-5592-4182-bee4-6fc9e00a8e8e (117b735b-5592-4182-bee4-6fc9e00a8e8e): created successfully
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a36c6476-385f-4cb9-a0bb-09d4a65e9a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Flow 'volume_create_manager' (72265247-3a93-4a48-b121-6a3da0df0069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:40 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c8290084-0ac1-4eb1-aa82-95b7416df482 tempest-VolumesActionsTest-1927676535 None] Created volume successfully.
Sep 16 16:15:40 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c8de24e0-5ac1-49bf-8748-3c0348b2e3f5 tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.285s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-c8de24e0-5ac1-49bf-8748-3c0348b2e3f5 tempest-VolumesGetTest-201328229 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:15:40 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c8de24e0-5ac1-49bf-8748-3c0348b2e3f5 tempest-VolumesGetTest-201328229 None] Deleted volume successfully.
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c8de24e0-5ac1-49bf-8748-3c0348b2e3f5 tempest-VolumesGetTest-201328229 None] Lock "cinder-2e7aaef9-07fa-49cf-b87f-49b380969500-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:40 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-86ba52b2-bed5-40a8-9dc1-972fedc00ba9 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414" returned: 0 in 0.473s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-86ba52b2-bed5-40a8-9dc1-972fedc00ba9 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:40 devstack sudo[95829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414
Sep 16 16:15:40 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:40 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-86ba52b2-bed5-40a8-9dc1-972fedc00ba9 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3c3affd4-48d7-408b-9b6c-294a56683414" returned: 0 in 0.257s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-86ba52b2-bed5-40a8-9dc1-972fedc00ba9 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Lock "cinder-quobyte-3c3affd4-48d7-408b-9b6c-294a56683414" released by "delete_volume" :: held 0.815s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-86ba52b2-bed5-40a8-9dc1-972fedc00ba9 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Created reservations ['5b29a29f-252a-4669-a756-c1b6ed1230f8', 'c58ec2c8-c047-4991-8040-90126957d42a', '7179740a-0f96-40b3-83fe-117fd290f228', 'a9258fe9-6d6e-4324-b4f2-0acc8bdb6e40'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-86ba52b2-bed5-40a8-9dc1-972fedc00ba9 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-86ba52b2-bed5-40a8-9dc1-972fedc00ba9 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-86ba52b2-bed5-40a8-9dc1-972fedc00ba9 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-86ba52b2-bed5-40a8-9dc1-972fedc00ba9 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-86ba52b2-bed5-40a8-9dc1-972fedc00ba9 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-86ba52b2-bed5-40a8-9dc1-972fedc00ba9 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:41 devstack sudo[95832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:15:41 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0c36bd93-c99d-4fbf-8c07-dbedf549ebd1 tempest-VolumesGetTest-201328229 None] Acquiring lock "cinder-eb9106e5-993d-4ff5-a4d6-3e4cd9402903-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0c36bd93-c99d-4fbf-8c07-dbedf549ebd1 tempest-VolumesGetTest-201328229 None] Lock "cinder-eb9106e5-993d-4ff5-a4d6-3e4cd9402903-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0c36bd93-c99d-4fbf-8c07-dbedf549ebd1 tempest-VolumesGetTest-201328229 None] Acquiring lock "cinder-quobyte-eb9106e5-993d-4ff5-a4d6-3e4cd9402903" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0c36bd93-c99d-4fbf-8c07-dbedf549ebd1 tempest-VolumesGetTest-201328229 None] Lock "cinder-quobyte-eb9106e5-993d-4ff5-a4d6-3e4cd9402903" acquired by "delete_volume" :: waited 0.047s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:41 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-86ba52b2-bed5-40a8-9dc1-972fedc00ba9 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.431s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:41 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-86ba52b2-bed5-40a8-9dc1-972fedc00ba9 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:15:41 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[971bb435-6688-4fb9-bd74-96588f61a95e]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0c36bd93-c99d-4fbf-8c07-dbedf549ebd1 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:41 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-86ba52b2-bed5-40a8-9dc1-972fedc00ba9 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Deleted volume successfully.
Sep 16 16:15:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-86ba52b2-bed5-40a8-9dc1-972fedc00ba9 tempest-VolumesSnapshotNegativeTestJSON-870124850 None] Lock "cinder-3c3affd4-48d7-408b-9b6c-294a56683414-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-37140ef0-18d6-4739-a2e2-bc72a52d8aa0 tempest-VolumesActionsTest-2124306866 None] Acquiring lock "cinder-117b735b-5592-4182-bee4-6fc9e00a8e8e-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-37140ef0-18d6-4739-a2e2-bc72a52d8aa0 tempest-VolumesActionsTest-2124306866 None] Lock "cinder-117b735b-5592-4182-bee4-6fc9e00a8e8e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-37140ef0-18d6-4739-a2e2-bc72a52d8aa0 tempest-VolumesActionsTest-2124306866 None] Acquiring lock "cinder-quobyte-117b735b-5592-4182-bee4-6fc9e00a8e8e" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-37140ef0-18d6-4739-a2e2-bc72a52d8aa0 tempest-VolumesActionsTest-2124306866 None] Lock "cinder-quobyte-117b735b-5592-4182-bee4-6fc9e00a8e8e" acquired by "delete_volume" :: waited 0.022s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:41 devstack sudo[95835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903
Sep 16 16:15:41 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:41 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6daa2c55-fcf2-4d14-bd38-a2ccfba4dc49]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-37140ef0-18d6-4739-a2e2-bc72a52d8aa0 tempest-VolumesActionsTest-2124306866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117b735b-5592-4182-bee4-6fc9e00a8e8e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:41 devstack sudo[95840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117b735b-5592-4182-bee4-6fc9e00a8e8e
Sep 16 16:15:41 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:41 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0c36bd93-c99d-4fbf-8c07-dbedf549ebd1 tempest-VolumesGetTest-201328229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903" returned: 0 in 0.576s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0c36bd93-c99d-4fbf-8c07-dbedf549ebd1 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:42 devstack sudo[95846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903
Sep 16 16:15:42 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:42 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-37140ef0-18d6-4739-a2e2-bc72a52d8aa0 tempest-VolumesActionsTest-2124306866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117b735b-5592-4182-bee4-6fc9e00a8e8e" returned: 0 in 0.505s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-37140ef0-18d6-4739-a2e2-bc72a52d8aa0 tempest-VolumesActionsTest-2124306866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117b735b-5592-4182-bee4-6fc9e00a8e8e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:42 devstack sudo[95851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117b735b-5592-4182-bee4-6fc9e00a8e8e
Sep 16 16:15:42 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:42 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0c36bd93-c99d-4fbf-8c07-dbedf549ebd1 tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-eb9106e5-993d-4ff5-a4d6-3e4cd9402903" returned: 0 in 0.335s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0c36bd93-c99d-4fbf-8c07-dbedf549ebd1 tempest-VolumesGetTest-201328229 None] Lock "cinder-quobyte-eb9106e5-993d-4ff5-a4d6-3e4cd9402903" released by "delete_volume" :: held 0.993s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:42 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-37140ef0-18d6-4739-a2e2-bc72a52d8aa0 tempest-VolumesActionsTest-2124306866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117b735b-5592-4182-bee4-6fc9e00a8e8e" returned: 0 in 0.268s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-37140ef0-18d6-4739-a2e2-bc72a52d8aa0 tempest-VolumesActionsTest-2124306866 None] Lock "cinder-quobyte-117b735b-5592-4182-bee4-6fc9e00a8e8e" released by "delete_volume" :: held 0.854s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-0c36bd93-c99d-4fbf-8c07-dbedf549ebd1 tempest-VolumesGetTest-201328229 None] Created reservations ['b94e5111-0c7d-4247-8740-92de90fb303b', 'af9f4a70-14ce-411e-9b9a-b9c21fc001a8', '7c8c1d15-4648-4e5d-a5a9-6cfd48d0cd31', '95650e26-2143-4bd2-a4af-e4cc7665f15b'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-37140ef0-18d6-4739-a2e2-bc72a52d8aa0 tempest-VolumesActionsTest-2124306866 None] Created reservations ['b031678e-f51e-4fb2-95dc-c424579346de', '3d34e838-6a32-4144-b886-9601639199a6', '0648f0d6-95f3-48c0-9616-9624410e9184', '1e948458-e9d3-4d45-b33b-170f076bc32d'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0c36bd93-c99d-4fbf-8c07-dbedf549ebd1 tempest-VolumesGetTest-201328229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0c36bd93-c99d-4fbf-8c07-dbedf549ebd1 tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0c36bd93-c99d-4fbf-8c07-dbedf549ebd1 tempest-VolumesGetTest-201328229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0c36bd93-c99d-4fbf-8c07-dbedf549ebd1 tempest-VolumesGetTest-201328229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0c36bd93-c99d-4fbf-8c07-dbedf549ebd1 tempest-VolumesGetTest-201328229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0c36bd93-c99d-4fbf-8c07-dbedf549ebd1 tempest-VolumesGetTest-201328229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:42 devstack sudo[95855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:15:42 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-37140ef0-18d6-4739-a2e2-bc72a52d8aa0 tempest-VolumesActionsTest-2124306866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-37140ef0-18d6-4739-a2e2-bc72a52d8aa0 tempest-VolumesActionsTest-2124306866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-37140ef0-18d6-4739-a2e2-bc72a52d8aa0 tempest-VolumesActionsTest-2124306866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-37140ef0-18d6-4739-a2e2-bc72a52d8aa0 tempest-VolumesActionsTest-2124306866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-37140ef0-18d6-4739-a2e2-bc72a52d8aa0 tempest-VolumesActionsTest-2124306866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-37140ef0-18d6-4739-a2e2-bc72a52d8aa0 tempest-VolumesActionsTest-2124306866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:42 devstack sudo[95857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:15:42 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:42 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0c36bd93-c99d-4fbf-8c07-dbedf549ebd1 tempest-VolumesGetTest-201328229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.311s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-0c36bd93-c99d-4fbf-8c07-dbedf549ebd1 tempest-VolumesGetTest-201328229 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:15:42 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-0c36bd93-c99d-4fbf-8c07-dbedf549ebd1 tempest-VolumesGetTest-201328229 None] Deleted volume successfully.
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0c36bd93-c99d-4fbf-8c07-dbedf549ebd1 tempest-VolumesGetTest-201328229 None] Lock "cinder-eb9106e5-993d-4ff5-a4d6-3e4cd9402903-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:42 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-37140ef0-18d6-4739-a2e2-bc72a52d8aa0 tempest-VolumesActionsTest-2124306866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.336s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-37140ef0-18d6-4739-a2e2-bc72a52d8aa0 tempest-VolumesActionsTest-2124306866 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:15:42 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-37140ef0-18d6-4739-a2e2-bc72a52d8aa0 tempest-VolumesActionsTest-2124306866 None] Deleted volume successfully.
Sep 16 16:15:42 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-37140ef0-18d6-4739-a2e2-bc72a52d8aa0 tempest-VolumesActionsTest-2124306866 None] Lock "cinder-117b735b-5592-4182-bee4-6fc9e00a8e8e-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Flow 'volume_create_manager' (6f777b21-06fa-4571-a5fa-baa90fd3fcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c1bfad-de8e-4776-867b-01fe9fa0db7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c1bfad-de8e-4776-867b-01fe9fa0db7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1957866432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d689de67-9de3-43f4-a6b6-1f80de6832a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f841a1e80942487fb87b9d50198ca525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:43Z,use_quota=True,user_id='42a6c8f96a654b4587cf55ff47661d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c14837-9437-4c46-a344-cee62902b577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c14837-9437-4c46-a344-cee62902b577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e461664-2f04-4855-87fd-2d33b206bbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e461664-2f04-4855-87fd-2d33b206bbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd689de67-9de3-43f4-a6b6-1f80de6832a0', 'volume_name': 'volume-d689de67-9de3-43f4-a6b6-1f80de6832a0', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47bfd362-7654-45d7-be7f-5500759312ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47bfd362-7654-45d7-be7f-5500759312ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c884173a-0344-4e63-a0b9-ed46e643eb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:43 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Volume d689de67-9de3-43f4-a6b6-1f80de6832a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d689de67-9de3-43f4-a6b6-1f80de6832a0', 'volume_size': 1}
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1957866432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d689de67-9de3-43f4-a6b6-1f80de6832a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f841a1e80942487fb87b9d50198ca525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:43Z,use_quota=True,user_id='42a6c8f96a654b4587cf55ff47661d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Creating volume d689de67-9de3-43f4-a6b6-1f80de6832a0 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:15:43 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d689de67-9de3-43f4-a6b6-1f80de6832a0 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:43 devstack sudo[95861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d689de67-9de3-43f4-a6b6-1f80de6832a0 1073741824
Sep 16 16:15:43 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:43 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d689de67-9de3-43f4-a6b6-1f80de6832a0 1073741824" returned: 0 in 0.526s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d689de67-9de3-43f4-a6b6-1f80de6832a0 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:44 devstack sudo[95867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d689de67-9de3-43f4-a6b6-1f80de6832a0
Sep 16 16:15:44 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:44 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d689de67-9de3-43f4-a6b6-1f80de6832a0" returned: 0 in 0.300s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:15:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c884173a-0344-4e63-a0b9-ed46e643eb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d689de67-9de3-43f4-a6b6-1f80de6832a0', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121e49e9-77ad-4908-bba1-dffeb5b236e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:44 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Volume volume-d689de67-9de3-43f4-a6b6-1f80de6832a0 (d689de67-9de3-43f4-a6b6-1f80de6832a0): created successfully
Sep 16 16:15:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121e49e9-77ad-4908-bba1-dffeb5b236e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Flow 'volume_create_manager' (6f777b21-06fa-4571-a5fa-baa90fd3fcfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:44 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-6bd4c8d8-248a-434f-ad1f-f12c03250d4c tempest-VolumesActionsTest-1927676535 None] Created volume successfully.
Sep 16 16:15:45 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f8022412-83f5-4639-a434-2856cf4f7289 tempest-VolumesActionsTest-2124306866 None] Acquiring lock "cinder-d689de67-9de3-43f4-a6b6-1f80de6832a0-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:45 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f8022412-83f5-4639-a434-2856cf4f7289 tempest-VolumesActionsTest-2124306866 None] Lock "cinder-d689de67-9de3-43f4-a6b6-1f80de6832a0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:45 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f8022412-83f5-4639-a434-2856cf4f7289 tempest-VolumesActionsTest-2124306866 None] Acquiring lock "cinder-quobyte-d689de67-9de3-43f4-a6b6-1f80de6832a0" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:45 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f8022412-83f5-4639-a434-2856cf4f7289 tempest-VolumesActionsTest-2124306866 None] Lock "cinder-quobyte-d689de67-9de3-43f4-a6b6-1f80de6832a0" acquired by "delete_volume" :: waited 0.022s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:45 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaac4fbc-aabe-4a0b-b953-fdfb591037cd]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f8022412-83f5-4639-a434-2856cf4f7289 tempest-VolumesActionsTest-2124306866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d689de67-9de3-43f4-a6b6-1f80de6832a0 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:45 devstack sudo[95879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d689de67-9de3-43f4-a6b6-1f80de6832a0
Sep 16 16:15:45 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:46 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f8022412-83f5-4639-a434-2856cf4f7289 tempest-VolumesActionsTest-2124306866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d689de67-9de3-43f4-a6b6-1f80de6832a0" returned: 0 in 0.485s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f8022412-83f5-4639-a434-2856cf4f7289 tempest-VolumesActionsTest-2124306866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d689de67-9de3-43f4-a6b6-1f80de6832a0 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:46 devstack sudo[95884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d689de67-9de3-43f4-a6b6-1f80de6832a0
Sep 16 16:15:46 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:46 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f8022412-83f5-4639-a434-2856cf4f7289 tempest-VolumesActionsTest-2124306866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d689de67-9de3-43f4-a6b6-1f80de6832a0" returned: 0 in 0.300s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:46 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f8022412-83f5-4639-a434-2856cf4f7289 tempest-VolumesActionsTest-2124306866 None] Lock "cinder-quobyte-d689de67-9de3-43f4-a6b6-1f80de6832a0" released by "delete_volume" :: held 0.846s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:46 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-f8022412-83f5-4639-a434-2856cf4f7289 tempest-VolumesActionsTest-2124306866 None] Created reservations ['7ec16a4f-8e08-48eb-8ac0-9c9581bde60e', '865b2438-96c8-48c5-8b73-d68f06df1f62', 'be68f6f4-1b1f-464f-a076-b1183af032eb', '4ff1be55-a216-4d36-95da-65ee14da822a'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:15:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f8022412-83f5-4639-a434-2856cf4f7289 tempest-VolumesActionsTest-2124306866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f8022412-83f5-4639-a434-2856cf4f7289 tempest-VolumesActionsTest-2124306866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:46 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-f8022412-83f5-4639-a434-2856cf4f7289 tempest-VolumesActionsTest-2124306866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:46 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-f8022412-83f5-4639-a434-2856cf4f7289 tempest-VolumesActionsTest-2124306866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f8022412-83f5-4639-a434-2856cf4f7289 tempest-VolumesActionsTest-2124306866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f8022412-83f5-4639-a434-2856cf4f7289 tempest-VolumesActionsTest-2124306866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:46 devstack sudo[95887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:15:46 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:47 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f8022412-83f5-4639-a434-2856cf4f7289 tempest-VolumesActionsTest-2124306866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.407s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-f8022412-83f5-4639-a434-2856cf4f7289 tempest-VolumesActionsTest-2124306866 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:15:47 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-f8022412-83f5-4639-a434-2856cf4f7289 tempest-VolumesActionsTest-2124306866 None] Deleted volume successfully.
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f8022412-83f5-4639-a434-2856cf4f7289 tempest-VolumesActionsTest-2124306866 None] Lock "cinder-d689de67-9de3-43f4-a6b6-1f80de6832a0-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Flow 'volume_create_manager' (5f36441c-435e-47d7-b076-49687ecc8c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b3f8ba-1c15-49ab-ad34-78ec0bf1c6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b3f8ba-1c15-49ab-ad34-78ec0bf1c6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1693416743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d7d1f7b-7cba-4942-9086-60e1edc6e511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f841a1e80942487fb87b9d50198ca525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:48Z,use_quota=True,user_id='42a6c8f96a654b4587cf55ff47661d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae820106-8aae-4af5-823d-e62ce4ecbcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae820106-8aae-4af5-823d-e62ce4ecbcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223d8031-185e-4210-aaec-a4364ef142d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223d8031-185e-4210-aaec-a4364ef142d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d7d1f7b-7cba-4942-9086-60e1edc6e511', 'volume_name': 'volume-2d7d1f7b-7cba-4942-9086-60e1edc6e511', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4d4771-9322-4850-916a-72e0fc7c77bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4d4771-9322-4850-916a-72e0fc7c77bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820eaad8-4387-4789-a2bf-20b0176fc262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:47 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Volume 2d7d1f7b-7cba-4942-9086-60e1edc6e511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d7d1f7b-7cba-4942-9086-60e1edc6e511', 'volume_size': 1}
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1693416743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d7d1f7b-7cba-4942-9086-60e1edc6e511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f841a1e80942487fb87b9d50198ca525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:48Z,use_quota=True,user_id='42a6c8f96a654b4587cf55ff47661d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Creating volume 2d7d1f7b-7cba-4942-9086-60e1edc6e511 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:15:47 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:15:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d7d1f7b-7cba-4942-9086-60e1edc6e511 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:47 devstack sudo[95890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d7d1f7b-7cba-4942-9086-60e1edc6e511 1073741824
Sep 16 16:15:47 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Flow 'volume_create_manager' (1e6bc3ad-8ead-4279-894d-268a919547f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (998714b3-09e8-47d0-b840-62cd9d0336c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (998714b3-09e8-47d0-b840-62cd9d0336c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1952120633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7469d858-bbf1-476e-ba52-92722bffed83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1107f3481f4f02b9feec69b786841d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:48Z,use_quota=True,user_id='6728b59dbf9e4594b1fc3294e294a4fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41be3b5-8774-4350-b91e-3d7090f412f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41be3b5-8774-4350-b91e-3d7090f412f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a2431f-803f-4af6-a69f-8b9e85176e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a2431f-803f-4af6-a69f-8b9e85176e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7469d858-bbf1-476e-ba52-92722bffed83', 'volume_name': 'volume-7469d858-bbf1-476e-ba52-92722bffed83', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e51d54-79ef-43a7-9424-5d82a21afda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e51d54-79ef-43a7-9424-5d82a21afda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0075510-9639-4e41-af7f-685172e489ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:48 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Volume 7469d858-bbf1-476e-ba52-92722bffed83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7469d858-bbf1-476e-ba52-92722bffed83', 'volume_size': 1}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:48 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d7d1f7b-7cba-4942-9086-60e1edc6e511 1073741824" returned: 0 in 0.741s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d7d1f7b-7cba-4942-9086-60e1edc6e511 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:48 devstack sudo[95898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d7d1f7b-7cba-4942-9086-60e1edc6e511
Sep 16 16:15:48 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:48 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d7d1f7b-7cba-4942-9086-60e1edc6e511" returned: 0 in 0.319s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.465s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1952120633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7469d858-bbf1-476e-ba52-92722bffed83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1107f3481f4f02b9feec69b786841d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:48Z,use_quota=True,user_id='6728b59dbf9e4594b1fc3294e294a4fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Creating volume 7469d858-bbf1-476e-ba52-92722bffed83 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:15:48 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7469d858-bbf1-476e-ba52-92722bffed83 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820eaad8-4387-4789-a2bf-20b0176fc262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d7d1f7b-7cba-4942-9086-60e1edc6e511', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b578a1f6-d881-45b5-9609-7a073d0ceb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:49 devstack sudo[95901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7469d858-bbf1-476e-ba52-92722bffed83 1073741824
Sep 16 16:15:49 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:49 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Volume volume-2d7d1f7b-7cba-4942-9086-60e1edc6e511 (2d7d1f7b-7cba-4942-9086-60e1edc6e511): created successfully
Sep 16 16:15:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b578a1f6-d881-45b5-9609-7a073d0ceb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Flow 'volume_create_manager' (5f36441c-435e-47d7-b076-49687ecc8c40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:49 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-bb1b6cff-b218-4fad-a788-f7c532822832 tempest-VolumesActionsTest-1927676535 None] Created volume successfully.
Sep 16 16:15:49 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7469d858-bbf1-476e-ba52-92722bffed83 1073741824" returned: 0 in 0.777s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7469d858-bbf1-476e-ba52-92722bffed83 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:49 devstack sudo[95929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7469d858-bbf1-476e-ba52-92722bffed83
Sep 16 16:15:49 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d12d1ce2-c159-4a36-b12c-af1c811143db tempest-VolumesActionsTest-2124306866 None] Acquiring lock "cinder-2d7d1f7b-7cba-4942-9086-60e1edc6e511-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d12d1ce2-c159-4a36-b12c-af1c811143db tempest-VolumesActionsTest-2124306866 None] Lock "cinder-2d7d1f7b-7cba-4942-9086-60e1edc6e511-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:50 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7469d858-bbf1-476e-ba52-92722bffed83" returned: 0 in 0.379s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:50 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:15:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d12d1ce2-c159-4a36-b12c-af1c811143db tempest-VolumesActionsTest-2124306866 None] Acquiring lock "cinder-quobyte-2d7d1f7b-7cba-4942-9086-60e1edc6e511" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d12d1ce2-c159-4a36-b12c-af1c811143db tempest-VolumesActionsTest-2124306866 None] Lock "cinder-quobyte-2d7d1f7b-7cba-4942-9086-60e1edc6e511" acquired by "delete_volume" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:50 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0075510-9639-4e41-af7f-685172e489ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7469d858-bbf1-476e-ba52-92722bffed83', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:50 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49cc46aa-db4c-4a76-b9ed-d037420728d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:50 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ac483d-6ad2-46a6-8ee6-674499f01f50]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d12d1ce2-c159-4a36-b12c-af1c811143db tempest-VolumesActionsTest-2124306866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d7d1f7b-7cba-4942-9086-60e1edc6e511 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:50 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Volume volume-7469d858-bbf1-476e-ba52-92722bffed83 (7469d858-bbf1-476e-ba52-92722bffed83): created successfully
Sep 16 16:15:50 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49cc46aa-db4c-4a76-b9ed-d037420728d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:50 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Flow 'volume_create_manager' (1e6bc3ad-8ead-4279-894d-268a919547f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:50 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-9628a96a-417f-4029-bbbb-feaea4e80c1d tempest-VolumesNegativeTest-739275250 None] Created volume successfully.
Sep 16 16:15:50 devstack sudo[95933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d7d1f7b-7cba-4942-9086-60e1edc6e511
Sep 16 16:15:50 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:50 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d12d1ce2-c159-4a36-b12c-af1c811143db tempest-VolumesActionsTest-2124306866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d7d1f7b-7cba-4942-9086-60e1edc6e511" returned: 0 in 0.721s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d12d1ce2-c159-4a36-b12c-af1c811143db tempest-VolumesActionsTest-2124306866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d7d1f7b-7cba-4942-9086-60e1edc6e511 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:50 devstack sudo[95941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d7d1f7b-7cba-4942-9086-60e1edc6e511
Sep 16 16:15:50 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:51 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d12d1ce2-c159-4a36-b12c-af1c811143db tempest-VolumesActionsTest-2124306866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d7d1f7b-7cba-4942-9086-60e1edc6e511" returned: 0 in 0.278s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:51 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d12d1ce2-c159-4a36-b12c-af1c811143db tempest-VolumesActionsTest-2124306866 None] Lock "cinder-quobyte-2d7d1f7b-7cba-4942-9086-60e1edc6e511" released by "delete_volume" :: held 1.057s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:51 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-d12d1ce2-c159-4a36-b12c-af1c811143db tempest-VolumesActionsTest-2124306866 None] Created reservations ['7135d64d-e390-4197-bb36-8c826ac6e2f9', '95fd90c3-7c04-4eaa-944c-cffddb1fd7e8', '40bc695a-b0d6-4be8-8225-0edee0cea6b1', 'd9a5ef00-bb00-428b-b7af-7b1fa30ff565'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:15:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d12d1ce2-c159-4a36-b12c-af1c811143db tempest-VolumesActionsTest-2124306866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d12d1ce2-c159-4a36-b12c-af1c811143db tempest-VolumesActionsTest-2124306866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d12d1ce2-c159-4a36-b12c-af1c811143db tempest-VolumesActionsTest-2124306866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d12d1ce2-c159-4a36-b12c-af1c811143db tempest-VolumesActionsTest-2124306866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d12d1ce2-c159-4a36-b12c-af1c811143db tempest-VolumesActionsTest-2124306866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d12d1ce2-c159-4a36-b12c-af1c811143db tempest-VolumesActionsTest-2124306866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:51 devstack sudo[95945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:15:51 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:51 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d12d1ce2-c159-4a36-b12c-af1c811143db tempest-VolumesActionsTest-2124306866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.346s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:51 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-d12d1ce2-c159-4a36-b12c-af1c811143db tempest-VolumesActionsTest-2124306866 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:15:51 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-d12d1ce2-c159-4a36-b12c-af1c811143db tempest-VolumesActionsTest-2124306866 None] Deleted volume successfully.
Sep 16 16:15:51 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d12d1ce2-c159-4a36-b12c-af1c811143db tempest-VolumesActionsTest-2124306866 None] Lock "cinder-2d7d1f7b-7cba-4942-9086-60e1edc6e511-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:53 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:15:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Flow 'volume_create_manager' (90ca858b-3eda-418e-99aa-356801b5a86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e723cc9-05d4-4b75-8716-c19985145b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e723cc9-05d4-4b75-8716-c19985145b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-261912496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35a549b4-632c-4651-89ce-220d470d72af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f841a1e80942487fb87b9d50198ca525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:53Z,use_quota=True,user_id='42a6c8f96a654b4587cf55ff47661d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246ce7c0-fb2c-4062-adb6-1d22d4e2cc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246ce7c0-fb2c-4062-adb6-1d22d4e2cc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f8f3f8-23d7-47d4-bf65-620d2fc46280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f8f3f8-23d7-47d4-bf65-620d2fc46280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35a549b4-632c-4651-89ce-220d470d72af', 'volume_name': 'volume-35a549b4-632c-4651-89ce-220d470d72af', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e817d25f-8225-4a1c-805c-b1c32369e542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e817d25f-8225-4a1c-805c-b1c32369e542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (061be96f-3db3-47bf-854c-260c648229e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:53 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Volume 35a549b4-632c-4651-89ce-220d470d72af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35a549b4-632c-4651-89ce-220d470d72af', 'volume_size': 1}
Sep 16 16:15:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-261912496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35a549b4-632c-4651-89ce-220d470d72af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f841a1e80942487fb87b9d50198ca525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:53Z,use_quota=True,user_id='42a6c8f96a654b4587cf55ff47661d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:15:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Creating volume 35a549b4-632c-4651-89ce-220d470d72af {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:15:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:15:53 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:15:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-35a549b4-632c-4651-89ce-220d470d72af 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:53 devstack sudo[95952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-35a549b4-632c-4651-89ce-220d470d72af 1073741824
Sep 16 16:15:53 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:54 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-35a549b4-632c-4651-89ce-220d470d72af 1073741824" returned: 0 in 0.619s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-35a549b4-632c-4651-89ce-220d470d72af {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:54 devstack sudo[95958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-35a549b4-632c-4651-89ce-220d470d72af
Sep 16 16:15:54 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:54 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-35a549b4-632c-4651-89ce-220d470d72af" returned: 0 in 0.346s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:15:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (061be96f-3db3-47bf-854c-260c648229e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35a549b4-632c-4651-89ce-220d470d72af', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352f6d54-88d0-4a9d-8aa8-4e3f9f296f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:54 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Volume volume-35a549b4-632c-4651-89ce-220d470d72af (35a549b4-632c-4651-89ce-220d470d72af): created successfully
Sep 16 16:15:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352f6d54-88d0-4a9d-8aa8-4e3f9f296f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Flow 'volume_create_manager' (90ca858b-3eda-418e-99aa-356801b5a86b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:54 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-27cc805f-6c0b-499a-b5b9-efe4de609cc2 tempest-VolumesActionsTest-1927676535 None] Created volume successfully.
Sep 16 16:15:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cd11fb06-8ab2-4097-904e-706db221139c tempest-VolumesActionsTest-2124306866 None] Acquiring lock "cinder-35a549b4-632c-4651-89ce-220d470d72af-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cd11fb06-8ab2-4097-904e-706db221139c tempest-VolumesActionsTest-2124306866 None] Lock "cinder-35a549b4-632c-4651-89ce-220d470d72af-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cd11fb06-8ab2-4097-904e-706db221139c tempest-VolumesActionsTest-2124306866 None] Acquiring lock "cinder-quobyte-35a549b4-632c-4651-89ce-220d470d72af" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:15:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cd11fb06-8ab2-4097-904e-706db221139c tempest-VolumesActionsTest-2124306866 None] Lock "cinder-quobyte-35a549b4-632c-4651-89ce-220d470d72af" acquired by "delete_volume" :: waited 0.032s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:15:55 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e164d4-625e-4daa-a4f7-e4a5feb2d8db]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:15:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cd11fb06-8ab2-4097-904e-706db221139c tempest-VolumesActionsTest-2124306866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-35a549b4-632c-4651-89ce-220d470d72af {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:56 devstack sudo[95966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-35a549b4-632c-4651-89ce-220d470d72af
Sep 16 16:15:56 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:56 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cd11fb06-8ab2-4097-904e-706db221139c tempest-VolumesActionsTest-2124306866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-35a549b4-632c-4651-89ce-220d470d72af" returned: 0 in 0.515s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cd11fb06-8ab2-4097-904e-706db221139c tempest-VolumesActionsTest-2124306866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-35a549b4-632c-4651-89ce-220d470d72af {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:56 devstack sudo[95982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-35a549b4-632c-4651-89ce-220d470d72af
Sep 16 16:15:56 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:56 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cd11fb06-8ab2-4097-904e-706db221139c tempest-VolumesActionsTest-2124306866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-35a549b4-632c-4651-89ce-220d470d72af" returned: 0 in 0.291s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:56 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cd11fb06-8ab2-4097-904e-706db221139c tempest-VolumesActionsTest-2124306866 None] Lock "cinder-quobyte-35a549b4-632c-4651-89ce-220d470d72af" released by "delete_volume" :: held 0.885s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:56 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-cd11fb06-8ab2-4097-904e-706db221139c tempest-VolumesActionsTest-2124306866 None] Created reservations ['08947a59-0090-4184-9d49-8895e7540722', '9eafad26-1f25-4c9a-9200-add1c87484ec', 'e1d660c7-bc0d-4968-86ee-95d59162dd21', '91fe80e6-1882-4538-97fe-8ca571c5947c'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:15:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cd11fb06-8ab2-4097-904e-706db221139c tempest-VolumesActionsTest-2124306866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cd11fb06-8ab2-4097-904e-706db221139c tempest-VolumesActionsTest-2124306866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-cd11fb06-8ab2-4097-904e-706db221139c tempest-VolumesActionsTest-2124306866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-cd11fb06-8ab2-4097-904e-706db221139c tempest-VolumesActionsTest-2124306866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cd11fb06-8ab2-4097-904e-706db221139c tempest-VolumesActionsTest-2124306866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cd11fb06-8ab2-4097-904e-706db221139c tempest-VolumesActionsTest-2124306866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:56 devstack sudo[95985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:15:56 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:57 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cd11fb06-8ab2-4097-904e-706db221139c tempest-VolumesActionsTest-2124306866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.309s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-cd11fb06-8ab2-4097-904e-706db221139c tempest-VolumesActionsTest-2124306866 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:15:57 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-cd11fb06-8ab2-4097-904e-706db221139c tempest-VolumesActionsTest-2124306866 None] Deleted volume successfully.
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cd11fb06-8ab2-4097-904e-706db221139c tempest-VolumesActionsTest-2124306866 None] Lock "cinder-35a549b4-632c-4651-89ce-220d470d72af-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Flow 'volume_create_manager' (c1fd6583-6d83-4a99-9d9e-f82e063f752f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37003b7-b69e-41c8-9481-bdf0d551c567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37003b7-b69e-41c8-9481-bdf0d551c567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-872893371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6519def-86d2-4c8d-8e9f-22f146f1cc7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f841a1e80942487fb87b9d50198ca525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:58Z,use_quota=True,user_id='42a6c8f96a654b4587cf55ff47661d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d75b35-53ac-4ca4-b902-cf9003855df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d75b35-53ac-4ca4-b902-cf9003855df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92728af8-4ea4-4dce-8c55-4f2ec0a4d4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92728af8-4ea4-4dce-8c55-4f2ec0a4d4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6519def-86d2-4c8d-8e9f-22f146f1cc7c', 'volume_name': 'volume-b6519def-86d2-4c8d-8e9f-22f146f1cc7c', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97cab319-2349-495b-8154-66f4d0195eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97cab319-2349-495b-8154-66f4d0195eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c3c0e0-20c6-4799-a4ae-8623ba968086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:57 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Volume b6519def-86d2-4c8d-8e9f-22f146f1cc7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6519def-86d2-4c8d-8e9f-22f146f1cc7c', 'volume_size': 1}
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-872893371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6519def-86d2-4c8d-8e9f-22f146f1cc7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f841a1e80942487fb87b9d50198ca525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:58Z,use_quota=True,user_id='42a6c8f96a654b4587cf55ff47661d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Creating volume b6519def-86d2-4c8d-8e9f-22f146f1cc7c {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:15:57 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:15:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b6519def-86d2-4c8d-8e9f-22f146f1cc7c 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:57 devstack sudo[95988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b6519def-86d2-4c8d-8e9f-22f146f1cc7c 1073741824
Sep 16 16:15:57 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:58 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b6519def-86d2-4c8d-8e9f-22f146f1cc7c 1073741824" returned: 0 in 0.660s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b6519def-86d2-4c8d-8e9f-22f146f1cc7c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:15:58 devstack sudo[96030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b6519def-86d2-4c8d-8e9f-22f146f1cc7c
Sep 16 16:15:58 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:15:58 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root
Sep 16 16:15:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b6519def-86d2-4c8d-8e9f-22f146f1cc7c" returned: 0 in 0.347s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:15:58 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:15:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:15:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c3c0e0-20c6-4799-a4ae-8623ba968086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6519def-86d2-4c8d-8e9f-22f146f1cc7c', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3aefcb-650f-4330-9abe-a12897853d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:15:58 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Volume volume-b6519def-86d2-4c8d-8e9f-22f146f1cc7c (b6519def-86d2-4c8d-8e9f-22f146f1cc7c): created successfully
Sep 16 16:15:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3aefcb-650f-4330-9abe-a12897853d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:15:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Flow 'volume_create_manager' (c1fd6583-6d83-4a99-9d9e-f82e063f752f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:15:58 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b662af13-3495-4524-9ff3-0658c690dc97 tempest-VolumesActionsTest-1927676535 None] Created volume successfully.
Sep 16 16:16:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3b12eb5b-c8b9-4b90-bb42-669f6d48adf4 tempest-VolumesActionsTest-1927676535 None] Acquiring lock "cinder-b6519def-86d2-4c8d-8e9f-22f146f1cc7c-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:16:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3b12eb5b-c8b9-4b90-bb42-669f6d48adf4 tempest-VolumesActionsTest-1927676535 None] Lock "cinder-b6519def-86d2-4c8d-8e9f-22f146f1cc7c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:16:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3b12eb5b-c8b9-4b90-bb42-669f6d48adf4 tempest-VolumesActionsTest-1927676535 None] Acquiring lock "cinder-quobyte-b6519def-86d2-4c8d-8e9f-22f146f1cc7c" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:16:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3b12eb5b-c8b9-4b90-bb42-669f6d48adf4 tempest-VolumesActionsTest-1927676535 None] Lock "cinder-quobyte-b6519def-86d2-4c8d-8e9f-22f146f1cc7c" acquired by "delete_volume" :: waited 0.021s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:16:00 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6993e917-3434-4f3c-83a9-87f7340025d0]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:16:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3b12eb5b-c8b9-4b90-bb42-669f6d48adf4 tempest-VolumesActionsTest-1927676535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b6519def-86d2-4c8d-8e9f-22f146f1cc7c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:00 devstack sudo[96035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b6519def-86d2-4c8d-8e9f-22f146f1cc7c
Sep 16 16:16:00 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:01 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3b12eb5b-c8b9-4b90-bb42-669f6d48adf4 tempest-VolumesActionsTest-1927676535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b6519def-86d2-4c8d-8e9f-22f146f1cc7c" returned: 0 in 0.650s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3b12eb5b-c8b9-4b90-bb42-669f6d48adf4 tempest-VolumesActionsTest-1927676535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b6519def-86d2-4c8d-8e9f-22f146f1cc7c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:01 devstack sudo[96042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b6519def-86d2-4c8d-8e9f-22f146f1cc7c
Sep 16 16:16:01 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:01 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3b12eb5b-c8b9-4b90-bb42-669f6d48adf4 tempest-VolumesActionsTest-1927676535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b6519def-86d2-4c8d-8e9f-22f146f1cc7c" returned: 0 in 0.283s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:01 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3b12eb5b-c8b9-4b90-bb42-669f6d48adf4 tempest-VolumesActionsTest-1927676535 None] Lock "cinder-quobyte-b6519def-86d2-4c8d-8e9f-22f146f1cc7c" released by "delete_volume" :: held 0.986s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:16:01 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-3b12eb5b-c8b9-4b90-bb42-669f6d48adf4 tempest-VolumesActionsTest-1927676535 None] Created reservations ['68c2a054-abf7-4535-af3b-918529c4482c', 'c607afb2-c820-4c42-abfa-dab065d1d2d1', '8e19a2a3-e2ad-4e83-b508-b7dca743af2f', '23d8f6b8-b3b3-4462-9c0b-c2a21217d15e'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:16:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3b12eb5b-c8b9-4b90-bb42-669f6d48adf4 tempest-VolumesActionsTest-1927676535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:16:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3b12eb5b-c8b9-4b90-bb42-669f6d48adf4 tempest-VolumesActionsTest-1927676535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:16:01 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3b12eb5b-c8b9-4b90-bb42-669f6d48adf4 tempest-VolumesActionsTest-1927676535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:16:01 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3b12eb5b-c8b9-4b90-bb42-669f6d48adf4 tempest-VolumesActionsTest-1927676535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:16:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3b12eb5b-c8b9-4b90-bb42-669f6d48adf4 tempest-VolumesActionsTest-1927676535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:16:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3b12eb5b-c8b9-4b90-bb42-669f6d48adf4 tempest-VolumesActionsTest-1927676535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:01 devstack sudo[96045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:16:01 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:02 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3b12eb5b-c8b9-4b90-bb42-669f6d48adf4 tempest-VolumesActionsTest-1927676535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.291s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:02 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-3b12eb5b-c8b9-4b90-bb42-669f6d48adf4 tempest-VolumesActionsTest-1927676535 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:16:02 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-3b12eb5b-c8b9-4b90-bb42-669f6d48adf4 tempest-VolumesActionsTest-1927676535 None] Deleted volume successfully.
Sep 16 16:16:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3b12eb5b-c8b9-4b90-bb42-669f6d48adf4 tempest-VolumesActionsTest-1927676535 None] Lock "cinder-b6519def-86d2-4c8d-8e9f-22f146f1cc7c-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:16:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:16:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:16:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:16:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:16:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:16:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:16:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:07 devstack sudo[96140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:16:07 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:07 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.333s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:16:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:16:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 28 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:16:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>, <Thread(tpool_thread_0, started daemon 135438770624192)>, <Thread(tpool_thread_1, started daemon 135438762231488)>, <Thread(tpool_thread_2, started daemon 135438753838784)>, <Thread(tpool_thread_3, started daemon 135438745446080)>, <Thread(tpool_thread_4, started daemon 135438737053376)>, <Thread(tpool_thread_5, started daemon 135438728660672)>, <Thread(tpool_thread_6, started daemon 135438720267968)>, <Thread(tpool_thread_7, started daemon 135438711875264)>, <Thread(tpool_thread_8, started daemon 135438703466176)>, <Thread(tpool_thread_9, started daemon 135438695057088)>, <Thread(tpool_thread_10, started daemon 135438686648000)>, <Thread(tpool_thread_11, started daemon 135438678238912)>, <Thread(tpool_thread_12, started daemon 135438669829824)>, <Thread(tpool_thread_13, started daemon 135438661420736)>, <Thread(tpool_thread_14, started daemon 135438653011648)>, <Thread(tpool_thread_15, started daemon 135438644602560)>, <Thread(tpool_thread_16, started daemon 135438636193472)>, <Thread(tpool_thread_17, started daemon 135438627784384)>, <Thread(tpool_thread_18, started daemon 135438619375296)>, <Thread(tpool_thread_19, started daemon 135438610966208)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:16:11 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=170,cinder:SELECT=118,cinder:DELETE=16,cinder:INSERT=45 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:16:12 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=172,cinder:SELECT=130,cinder:INSERT=48,cinder:DELETE=13 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:16:20 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:16:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Flow 'volume_create_manager' (ece817df-a561-40f2-ba83-2a7afeeff719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:16:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db836321-b008-4719-8292-aae99a93a93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db836321-b008-4719-8292-aae99a93a93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1315681112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d9277d-b7fb-4c3d-8f96-5416120e11b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df03c233420b46148d449d9866437c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:21Z,use_quota=True,user_id='3a04b0acd1c943cc9c2f5e3b33104e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2be3781-9146-4adf-9c7f-a23721483c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2be3781-9146-4adf-9c7f-a23721483c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be3db96a-9fea-488e-a28f-5f1c7ac37fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:21 devstack cinder-volume[86165]: DEBUG cinder.image.glance [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Creating Keystone auth plugin from conf {{(pid=86165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 16:16:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be3db96a-9fea-488e-a28f-5f1c7ac37fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '33d9277d-b7fb-4c3d-8f96-5416120e11b7', 'volume_name': 'volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7', 'volume_size': 1, 'image_id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '896515a0bbf44034a5d624f4b911b6d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 2, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f1ed024-e14f-4371-8a39-a1d416ee528e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e4c2058e0>}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cbdf731-8773-40ae-b839-ed947d154b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cbdf731-8773-40ae-b839-ed947d154b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88446fe6-3281-4c64-bce4-b643c732c52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:21 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Volume 33d9277d-b7fb-4c3d-8f96-5416120e11b7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7', 'volume_size': 1, 'image_id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '896515a0bbf44034a5d624f4b911b6d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 2, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f1ed024-e14f-4371-8a39-a1d416ee528e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e4c2058e0>}
Sep 16 16:16:21 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Trying to clone 33d9277d-b7fb-4c3d-8f96-5416120e11b7 from image 4f1ed024-e14f-4371-8a39-a1d416ee528e at location (None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}]). {{(pid=86165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 16:16:22 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_hxbylkexdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 16:16:22 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Image download 20.69 MB at 20.69 MB/s
Sep 16 16:16:22 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cc27b5-edb6-4f02-bc17-013630f0f9d7]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:16:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_hxbylkexdevstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:22 devstack sudo[96249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_hxbylkexdevstack@QuobyteHD
Sep 16 16:16:22 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:22 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_hxbylkexdevstack@QuobyteHD" returned: 0 in 0.538s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:22 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Temporary image 4f1ed024-e14f-4371-8a39-a1d416ee528e is fetched for user 3a04b0acd1c943cc9c2f5e3b33104e5e. {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 16:16:22 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[76205fd6-4a1c-417f-8265-2aaad4f677b5]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:16:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_hxbylkexdevstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:23 devstack sudo[96256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_hxbylkexdevstack@QuobyteHD
Sep 16 16:16:23 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:23 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_hxbylkexdevstack@QuobyteHD" returned: 0 in 0.668s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:16:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:16:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1315681112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d9277d-b7fb-4c3d-8f96-5416120e11b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df03c233420b46148d449d9866437c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:21Z,use_quota=True,user_id='3a04b0acd1c943cc9c2f5e3b33104e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:16:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Creating volume 33d9277d-b7fb-4c3d-8f96-5416120e11b7 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:16:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:16:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:16:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:16:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:16:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:16:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:16:23 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:16:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:23 devstack sudo[96265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7 1073741824
Sep 16 16:16:23 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:24 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7 1073741824" returned: 0 in 0.850s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:24 devstack sudo[96270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7
Sep 16 16:16:24 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:24 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7" returned: 0 in 0.328s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:24 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:16:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:16:24 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Attempting download of 4f1ed024-e14f-4371-8a39-a1d416ee528e ((None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}])) to volume 33d9277d-b7fb-4c3d-8f96-5416120e11b7. {{(pid=86165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 16:16:25 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae488fa9-747c-448f-ab64-fd29f4b642e3]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:16:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_cwwqykum {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:25 devstack sudo[96273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_cwwqykum
Sep 16 16:16:25 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:25 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_cwwqykum" returned: 0 in 0.567s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_cwwqykum {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:25 devstack sudo[96277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_cwwqykum
Sep 16 16:16:25 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:26 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_cwwqykum" returned: 1 in 0.471s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1ed024-e14f-4371-8a39-a1d416ee528e_cwwqykum' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:16:26 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddb61c5-ba05-4ee1-a401-93b55e3772c1]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:16:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_hxbylkexdevstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:26 devstack sudo[96281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_hxbylkexdevstack@QuobyteHD
Sep 16 16:16:26 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:26 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_hxbylkexdevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:26 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] 4f1ed024-e14f-4371-8a39-a1d416ee528e was qcow2, converting to qcow2 {{(pid=86165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 16:16:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_hxbylkexdevstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:26 devstack sudo[96287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_hxbylkexdevstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7
Sep 16 16:16:26 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-df8b6f0b-c5e5-474f-bc07-a5e47e16e08c tempest-VolumesNegativeTest-739275250 None] Acquiring lock "cinder-7469d858-bbf1-476e-ba52-92722bffed83-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:16:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-df8b6f0b-c5e5-474f-bc07-a5e47e16e08c tempest-VolumesNegativeTest-739275250 None] Lock "cinder-7469d858-bbf1-476e-ba52-92722bffed83-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:16:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-df8b6f0b-c5e5-474f-bc07-a5e47e16e08c tempest-VolumesNegativeTest-739275250 None] Acquiring lock "cinder-quobyte-7469d858-bbf1-476e-ba52-92722bffed83" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:16:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-df8b6f0b-c5e5-474f-bc07-a5e47e16e08c tempest-VolumesNegativeTest-739275250 None] Lock "cinder-quobyte-7469d858-bbf1-476e-ba52-92722bffed83" acquired by "delete_volume" :: waited 0.027s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:16:28 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9abbd3b-0730-4934-9215-a11d2f66abd7]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:16:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-df8b6f0b-c5e5-474f-bc07-a5e47e16e08c tempest-VolumesNegativeTest-739275250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7469d858-bbf1-476e-ba52-92722bffed83 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:28 devstack sudo[96297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7469d858-bbf1-476e-ba52-92722bffed83
Sep 16 16:16:28 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:28 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-df8b6f0b-c5e5-474f-bc07-a5e47e16e08c tempest-VolumesNegativeTest-739275250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7469d858-bbf1-476e-ba52-92722bffed83" returned: 0 in 0.434s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-df8b6f0b-c5e5-474f-bc07-a5e47e16e08c tempest-VolumesNegativeTest-739275250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7469d858-bbf1-476e-ba52-92722bffed83 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:28 devstack sudo[96303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7469d858-bbf1-476e-ba52-92722bffed83
Sep 16 16:16:28 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:29 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_hxbylkexdevstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7" returned: 0 in 2.458s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4f1ed024-e14f-4371-8a39-a1d416ee528e_hxbylkexdevstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7 {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:16:29 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:29 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Converted 112.00 MB image at 45.54 MB/s
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-df8b6f0b-c5e5-474f-bc07-a5e47e16e08c tempest-VolumesNegativeTest-739275250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7469d858-bbf1-476e-ba52-92722bffed83" returned: 0 in 0.369s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-df8b6f0b-c5e5-474f-bc07-a5e47e16e08c tempest-VolumesNegativeTest-739275250 None] Lock "cinder-quobyte-7469d858-bbf1-476e-ba52-92722bffed83" released by "delete_volume" :: held 0.851s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:16:29 devstack sudo[96306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7 1G
Sep 16 16:16:29 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-df8b6f0b-c5e5-474f-bc07-a5e47e16e08c tempest-VolumesNegativeTest-739275250 None] Created reservations ['9adef01f-570d-4dc3-a635-8b4da75ea624', 'f67d4129-426c-4791-9cb4-2d749163a74e', '4e519c1f-f7d8-4eaf-9c72-9d2305ac6e87', '8ff82486-5b07-4bb6-97dd-db8a77e10a38'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-df8b6f0b-c5e5-474f-bc07-a5e47e16e08c tempest-VolumesNegativeTest-739275250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-df8b6f0b-c5e5-474f-bc07-a5e47e16e08c tempest-VolumesNegativeTest-739275250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-df8b6f0b-c5e5-474f-bc07-a5e47e16e08c tempest-VolumesNegativeTest-739275250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-df8b6f0b-c5e5-474f-bc07-a5e47e16e08c tempest-VolumesNegativeTest-739275250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-df8b6f0b-c5e5-474f-bc07-a5e47e16e08c tempest-VolumesNegativeTest-739275250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-df8b6f0b-c5e5-474f-bc07-a5e47e16e08c tempest-VolumesNegativeTest-739275250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:29 devstack sudo[96308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:16:29 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:29 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7 1G" returned: 0 in 0.418s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Downloaded image 4f1ed024-e14f-4371-8a39-a1d416ee528e ((None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}])) to volume 33d9277d-b7fb-4c3d-8f96-5416120e11b7 successfully. {{(pid=86165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Temporary image 4f1ed024-e14f-4371-8a39-a1d416ee528e for user 3a04b0acd1c943cc9c2f5e3b33104e5e is deleted. {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Marking volume 33d9277d-b7fb-4c3d-8f96-5416120e11b7 as bootable. {{(pid=86165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Copying metadata from image 4f1ed024-e14f-4371-8a39-a1d416ee528e to 33d9277d-b7fb-4c3d-8f96-5416120e11b7. {{(pid=86165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Creating volume glance metadata for volume 33d9277d-b7fb-4c3d-8f96-5416120e11b7 backed by image 4f1ed024-e14f-4371-8a39-a1d416ee528e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 16:16:29 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-df8b6f0b-c5e5-474f-bc07-a5e47e16e08c tempest-VolumesNegativeTest-739275250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.325s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-df8b6f0b-c5e5-474f-bc07-a5e47e16e08c tempest-VolumesNegativeTest-739275250 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:16:29 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-df8b6f0b-c5e5-474f-bc07-a5e47e16e08c tempest-VolumesNegativeTest-739275250 None] Deleted volume successfully.
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-df8b6f0b-c5e5-474f-bc07-a5e47e16e08c tempest-VolumesNegativeTest-739275250 None] Lock "cinder-7469d858-bbf1-476e-ba52-92722bffed83-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88446fe6-3281-4c64-bce4-b643c732c52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7', 'volume_size': 1, 'image_id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f1ed024-e14f-4371-8a39-a1d416ee528e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '896515a0bbf44034a5d624f4b911b6d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4f1ed024-e14f-4371-8a39-a1d416ee528e', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 2, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f1ed024-e14f-4371-8a39-a1d416ee528e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e4c2058e0>}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a872a2-9fea-4adc-b84d-233e71c660a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:29 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Volume volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7 (33d9277d-b7fb-4c3d-8f96-5416120e11b7): created successfully
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a872a2-9fea-4adc-b84d-233e71c660a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Flow 'volume_create_manager' (ece817df-a561-40f2-ba83-2a7afeeff719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:16:29 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-9fa41b0f-73d2-49a7-b0fe-2873abc4f736 tempest-TestShelveInstance-1732648310 None] Created volume successfully.
Sep 16 16:16:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-1a72edc8-3758-4a30-a25f-55d73ef61945 req-c4f042c7-4501-4382-9901-d3a02e268406 tempest-TestShelveInstance-1732648310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:16:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-1a72edc8-3758-4a30-a25f-55d73ef61945 req-c4f042c7-4501-4382-9901-d3a02e268406 tempest-TestShelveInstance-1732648310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:16:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-1a72edc8-3758-4a30-a25f-55d73ef61945 req-c4f042c7-4501-4382-9901-d3a02e268406 tempest-TestShelveInstance-1732648310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:16:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-1a72edc8-3758-4a30-a25f-55d73ef61945 req-c4f042c7-4501-4382-9901-d3a02e268406 tempest-TestShelveInstance-1732648310 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd4239df3-bb7d-41fc-99a2-25ca0cae26b2', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:16:33 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-1a72edc8-3758-4a30-a25f-55d73ef61945 req-c4f042c7-4501-4382-9901-d3a02e268406 tempest-TestShelveInstance-1732648310 None] attachment_update completed successfully.
Sep 16 16:16:40 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:16:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Flow 'volume_create_manager' (91a401ed-2e64-4155-991b-44dbb1d2695f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:16:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f27e78-d769-4ade-a305-a58de285f801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f27e78-d769-4ade-a305-a58de285f801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-358621023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da021213-e1fe-4243-b379-824582faa026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2d73119fdc48b781ff23ab41b3a281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:40Z,use_quota=True,user_id='57d968573a1646f0b18c1fd3e2a273c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d662b3a9-7678-4639-8fa7-8361b8f659b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d662b3a9-7678-4639-8fa7-8361b8f659b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46d52ae-e4f9-4287-88bd-c678d2f53ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46d52ae-e4f9-4287-88bd-c678d2f53ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da021213-e1fe-4243-b379-824582faa026', 'volume_name': 'volume-da021213-e1fe-4243-b379-824582faa026', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5471552-e01b-46a7-a1a1-374959f6f953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5471552-e01b-46a7-a1a1-374959f6f953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55df644d-f9a5-48da-8c03-bbfa0e0c20da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:40 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Volume da021213-e1fe-4243-b379-824582faa026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da021213-e1fe-4243-b379-824582faa026', 'volume_size': 1}
Sep 16 16:16:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:16:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:16:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-358621023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da021213-e1fe-4243-b379-824582faa026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2d73119fdc48b781ff23ab41b3a281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:40Z,use_quota=True,user_id='57d968573a1646f0b18c1fd3e2a273c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:16:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Creating volume da021213-e1fe-4243-b379-824582faa026 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:16:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:16:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:16:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:16:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:16:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:16:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:16:40 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:16:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-da021213-e1fe-4243-b379-824582faa026 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:40 devstack sudo[96827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-da021213-e1fe-4243-b379-824582faa026 1073741824
Sep 16 16:16:40 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:41 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-da021213-e1fe-4243-b379-824582faa026 1073741824" returned: 0 in 0.665s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-da021213-e1fe-4243-b379-824582faa026 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:41 devstack sudo[96833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-da021213-e1fe-4243-b379-824582faa026
Sep 16 16:16:41 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:41 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-da021213-e1fe-4243-b379-824582faa026" returned: 0 in 0.494s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:41 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:16:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:16:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55df644d-f9a5-48da-8c03-bbfa0e0c20da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da021213-e1fe-4243-b379-824582faa026', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9df458-255f-4294-a243-28775062dded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:41 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Volume volume-da021213-e1fe-4243-b379-824582faa026 (da021213-e1fe-4243-b379-824582faa026): created successfully
Sep 16 16:16:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9df458-255f-4294-a243-28775062dded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Flow 'volume_create_manager' (91a401ed-2e64-4155-991b-44dbb1d2695f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:16:41 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-023d9c33-c09d-4084-830c-24eec10c88d9 tempest-VolumesMetadataTest-1119593257 None] Created volume successfully.
Sep 16 16:16:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-442794d3-cd13-41fd-8c1f-cf4dc0774ed9 tempest-VolumesMetadataTest-1119593257 None] Acquiring lock "cinder-da021213-e1fe-4243-b379-824582faa026-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:16:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-442794d3-cd13-41fd-8c1f-cf4dc0774ed9 tempest-VolumesMetadataTest-1119593257 None] Lock "cinder-da021213-e1fe-4243-b379-824582faa026-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:16:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-442794d3-cd13-41fd-8c1f-cf4dc0774ed9 tempest-VolumesMetadataTest-1119593257 None] Acquiring lock "cinder-quobyte-da021213-e1fe-4243-b379-824582faa026" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:16:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-442794d3-cd13-41fd-8c1f-cf4dc0774ed9 tempest-VolumesMetadataTest-1119593257 None] Lock "cinder-quobyte-da021213-e1fe-4243-b379-824582faa026" acquired by "delete_volume" :: waited 0.027s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:16:43 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[98793cb4-d56d-4aa4-8607-2356f6287961]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:16:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-442794d3-cd13-41fd-8c1f-cf4dc0774ed9 tempest-VolumesMetadataTest-1119593257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-da021213-e1fe-4243-b379-824582faa026 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:44 devstack sudo[96838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-da021213-e1fe-4243-b379-824582faa026
Sep 16 16:16:44 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Flow 'volume_create_manager' (de8a5b12-3255-4c31-83ce-64af4d130300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0c2867-3107-48ea-8402-f13a23640958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0c2867-3107-48ea-8402-f13a23640958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1182060326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1661976f-c19d-4e9c-91d7-9974e9493cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b60be1392b4fa695313361f48663b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:44Z,use_quota=True,user_id='68b6a671260d4721925db004de72ce99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d37818b-3581-4f96-aa8c-b54b7d8f79e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d37818b-3581-4f96-aa8c-b54b7d8f79e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec6b431-9b23-45e0-9d5c-17027a0de4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec6b431-9b23-45e0-9d5c-17027a0de4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1661976f-c19d-4e9c-91d7-9974e9493cd1', 'volume_name': 'volume-1661976f-c19d-4e9c-91d7-9974e9493cd1', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81a6419-e494-4c48-88c9-3d2cb5894a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81a6419-e494-4c48-88c9-3d2cb5894a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb67330e-2cd9-45aa-893d-77913f6a4d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:44 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Volume 1661976f-c19d-4e9c-91d7-9974e9493cd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1661976f-c19d-4e9c-91d7-9974e9493cd1', 'volume_size': 1}
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1182060326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1661976f-c19d-4e9c-91d7-9974e9493cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b60be1392b4fa695313361f48663b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:44Z,use_quota=True,user_id='68b6a671260d4721925db004de72ce99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Creating volume 1661976f-c19d-4e9c-91d7-9974e9493cd1 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:16:44 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:16:44 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1661976f-c19d-4e9c-91d7-9974e9493cd1 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-442794d3-cd13-41fd-8c1f-cf4dc0774ed9 tempest-VolumesMetadataTest-1119593257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-da021213-e1fe-4243-b379-824582faa026" returned: 0 in 0.847s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-442794d3-cd13-41fd-8c1f-cf4dc0774ed9 tempest-VolumesMetadataTest-1119593257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-da021213-e1fe-4243-b379-824582faa026 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:44 devstack sudo[96845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1661976f-c19d-4e9c-91d7-9974e9493cd1 1073741824
Sep 16 16:16:44 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:44 devstack sudo[96846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-da021213-e1fe-4243-b379-824582faa026
Sep 16 16:16:44 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:45 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-442794d3-cd13-41fd-8c1f-cf4dc0774ed9 tempest-VolumesMetadataTest-1119593257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-da021213-e1fe-4243-b379-824582faa026" returned: 0 in 0.626s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:45 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-442794d3-cd13-41fd-8c1f-cf4dc0774ed9 tempest-VolumesMetadataTest-1119593257 None] Lock "cinder-quobyte-da021213-e1fe-4243-b379-824582faa026" released by "delete_volume" :: held 1.578s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:16:45 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-442794d3-cd13-41fd-8c1f-cf4dc0774ed9 tempest-VolumesMetadataTest-1119593257 None] Created reservations ['432381e2-7c23-4079-922b-961de9d17fda', '19fa64eb-f2df-456c-bf3e-f2d312afd809', 'cbbf0af0-beed-41aa-a3e9-c6d58422ca97', 'ca2476a3-ce1a-4648-83fa-6763142a2876'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:16:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-442794d3-cd13-41fd-8c1f-cf4dc0774ed9 tempest-VolumesMetadataTest-1119593257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:16:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-442794d3-cd13-41fd-8c1f-cf4dc0774ed9 tempest-VolumesMetadataTest-1119593257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:16:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-442794d3-cd13-41fd-8c1f-cf4dc0774ed9 tempest-VolumesMetadataTest-1119593257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:16:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-442794d3-cd13-41fd-8c1f-cf4dc0774ed9 tempest-VolumesMetadataTest-1119593257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:16:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-442794d3-cd13-41fd-8c1f-cf4dc0774ed9 tempest-VolumesMetadataTest-1119593257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:16:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-442794d3-cd13-41fd-8c1f-cf4dc0774ed9 tempest-VolumesMetadataTest-1119593257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:45 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1661976f-c19d-4e9c-91d7-9974e9493cd1 1073741824" returned: 0 in 1.067s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:45 devstack sudo[96856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:16:45 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1661976f-c19d-4e9c-91d7-9974e9493cd1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:46 devstack sudo[96861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1661976f-c19d-4e9c-91d7-9974e9493cd1
Sep 16 16:16:46 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:46 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-442794d3-cd13-41fd-8c1f-cf4dc0774ed9 tempest-VolumesMetadataTest-1119593257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.652s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:46 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-442794d3-cd13-41fd-8c1f-cf4dc0774ed9 tempest-VolumesMetadataTest-1119593257 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:16:46 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-442794d3-cd13-41fd-8c1f-cf4dc0774ed9 tempest-VolumesMetadataTest-1119593257 None] Deleted volume successfully.
Sep 16 16:16:46 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-442794d3-cd13-41fd-8c1f-cf4dc0774ed9 tempest-VolumesMetadataTest-1119593257 None] Lock "cinder-da021213-e1fe-4243-b379-824582faa026-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:16:46 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1661976f-c19d-4e9c-91d7-9974e9493cd1" returned: 0 in 0.574s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:46 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:16:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:16:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb67330e-2cd9-45aa-893d-77913f6a4d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1661976f-c19d-4e9c-91d7-9974e9493cd1', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4999dba4-18c6-498b-9da2-883dfcef80ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:46 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Volume volume-1661976f-c19d-4e9c-91d7-9974e9493cd1 (1661976f-c19d-4e9c-91d7-9974e9493cd1): created successfully
Sep 16 16:16:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4999dba4-18c6-498b-9da2-883dfcef80ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Flow 'volume_create_manager' (de8a5b12-3255-4c31-83ce-64af4d130300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:16:46 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-8d06c59b-9ed4-4bff-8a8b-4794eb3c5c05 tempest-AttachVolumeTestJSON-1114470276 None] Created volume successfully.
Sep 16 16:16:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-50ad8787-e9b5-4a64-be66-0ad86781be6b req-9ec08011-3b7a-4320-9f92-f0c2a85e075f tempest-AttachVolumeTestJSON-1114470276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:16:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-50ad8787-e9b5-4a64-be66-0ad86781be6b req-9ec08011-3b7a-4320-9f92-f0c2a85e075f tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:16:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-50ad8787-e9b5-4a64-be66-0ad86781be6b req-9ec08011-3b7a-4320-9f92-f0c2a85e075f tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:16:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-50ad8787-e9b5-4a64-be66-0ad86781be6b req-9ec08011-3b7a-4320-9f92-f0c2a85e075f tempest-AttachVolumeTestJSON-1114470276 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-1661976f-c19d-4e9c-91d7-9974e9493cd1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9eb0fd0-8771-4655-9d92-48d4f1cb40b6', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:16:48 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-50ad8787-e9b5-4a64-be66-0ad86781be6b req-9ec08011-3b7a-4320-9f92-f0c2a85e075f tempest-AttachVolumeTestJSON-1114470276 None] attachment_update completed successfully.
Sep 16 16:16:51 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:16:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Flow 'volume_create_manager' (c53e6b09-d028-4b30-82b2-128a8c37c415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:16:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286f570a-c241-421f-8622-52b0f7d93373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286f570a-c241-421f-8622-52b0f7d93373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-352401348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=313a50ac-c730-4d98-8454-5dea99336985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b60be1392b4fa695313361f48663b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:52Z,use_quota=True,user_id='68b6a671260d4721925db004de72ce99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09f929d-9706-44b1-b767-52ca5936b74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09f929d-9706-44b1-b767-52ca5936b74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d43d2899-8fb1-4141-9d13-235e83f779fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d43d2899-8fb1-4141-9d13-235e83f779fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '313a50ac-c730-4d98-8454-5dea99336985', 'volume_name': 'volume-313a50ac-c730-4d98-8454-5dea99336985', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9215a4-647f-4577-a060-52db7d9b7871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9215a4-647f-4577-a060-52db7d9b7871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27c0cdd-a126-482c-8a8b-776beec613af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:52 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Volume 313a50ac-c730-4d98-8454-5dea99336985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-313a50ac-c730-4d98-8454-5dea99336985', 'volume_size': 1}
Sep 16 16:16:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:16:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:16:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-352401348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=313a50ac-c730-4d98-8454-5dea99336985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b60be1392b4fa695313361f48663b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:52Z,use_quota=True,user_id='68b6a671260d4721925db004de72ce99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:16:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Creating volume 313a50ac-c730-4d98-8454-5dea99336985 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:16:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:16:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:16:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:16:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:16:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:16:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:16:52 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:16:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-313a50ac-c730-4d98-8454-5dea99336985 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:52 devstack sudo[96884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-313a50ac-c730-4d98-8454-5dea99336985 1073741824
Sep 16 16:16:52 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:52 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-313a50ac-c730-4d98-8454-5dea99336985 1073741824" returned: 0 in 0.666s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-313a50ac-c730-4d98-8454-5dea99336985 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:52 devstack sudo[96890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-313a50ac-c730-4d98-8454-5dea99336985
Sep 16 16:16:52 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:52 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:16:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Flow 'volume_create_manager' (b3932bac-2857-4814-acdc-9ebb5ef126bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:16:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f67ad9e-dcf4-4e98-be0d-5b8dc0a01aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f67ad9e-dcf4-4e98-be0d-5b8dc0a01aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-322524836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=485cd20c-049a-4965-a547-c35f7d2301f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37fcef055e25410684ae5abfd2b75c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:53Z,use_quota=True,user_id='90d9c6060eb148ebb09c0f5d8436e8ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (615d71f1-8d0e-4ce8-a048-bc4a16988f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (615d71f1-8d0e-4ce8-a048-bc4a16988f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b52447a2-ab17-46ea-a534-5da9007292c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b52447a2-ab17-46ea-a534-5da9007292c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '485cd20c-049a-4965-a547-c35f7d2301f8', 'volume_name': 'volume-485cd20c-049a-4965-a547-c35f7d2301f8', 'volume_size': 2}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5230f967-5454-479b-89ec-768888bd42ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5230f967-5454-479b-89ec-768888bd42ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f96e89-26de-41d5-9536-dea6150e90b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:53 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Volume 485cd20c-049a-4965-a547-c35f7d2301f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-485cd20c-049a-4965-a547-c35f7d2301f8', 'volume_size': 2}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:16:53 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-313a50ac-c730-4d98-8454-5dea99336985" returned: 0 in 0.404s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.118s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-322524836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=485cd20c-049a-4965-a547-c35f7d2301f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37fcef055e25410684ae5abfd2b75c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:53Z,use_quota=True,user_id='90d9c6060eb148ebb09c0f5d8436e8ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Creating volume 485cd20c-049a-4965-a547-c35f7d2301f8 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:16:53 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-485cd20c-049a-4965-a547-c35f7d2301f8 2147483648 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27c0cdd-a126-482c-8a8b-776beec613af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-313a50ac-c730-4d98-8454-5dea99336985', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40060ee1-207b-4aaa-9eb0-fdb5e062e97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:53 devstack sudo[96893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-485cd20c-049a-4965-a547-c35f7d2301f8 2147483648
Sep 16 16:16:53 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:53 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Volume volume-313a50ac-c730-4d98-8454-5dea99336985 (313a50ac-c730-4d98-8454-5dea99336985): created successfully
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40060ee1-207b-4aaa-9eb0-fdb5e062e97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Flow 'volume_create_manager' (c53e6b09-d028-4b30-82b2-128a8c37c415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:16:53 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-7838cd78-fc33-46b1-9a20-b91af008a80a tempest-AttachVolumeTestJSON-1114470276 None] Created volume successfully.
Sep 16 16:16:53 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-485cd20c-049a-4965-a547-c35f7d2301f8 2147483648" returned: 0 in 0.606s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-485cd20c-049a-4965-a547-c35f7d2301f8 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:53 devstack sudo[96899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-485cd20c-049a-4965-a547-c35f7d2301f8
Sep 16 16:16:53 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:54 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-485cd20c-049a-4965-a547-c35f7d2301f8" returned: 0 in 0.362s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:16:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:16:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f96e89-26de-41d5-9536-dea6150e90b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-485cd20c-049a-4965-a547-c35f7d2301f8', 'volume_size': 2}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6a7635-0355-4da2-b324-fcb294c9b48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:16:54 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Volume volume-485cd20c-049a-4965-a547-c35f7d2301f8 (485cd20c-049a-4965-a547-c35f7d2301f8): created successfully
Sep 16 16:16:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6a7635-0355-4da2-b324-fcb294c9b48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:16:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Flow 'volume_create_manager' (b3932bac-2857-4814-acdc-9ebb5ef126bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:16:54 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-29fdf2d9-78bb-44c3-b967-79084e89e5f1 tempest-VolumesCloneNegativeTest-281995381 None] Created volume successfully.
Sep 16 16:16:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-99004735-d522-4151-9cc3-9ec813d15bd8 req-32d1ace2-da9d-4763-a61a-13fec83c6522 tempest-AttachVolumeTestJSON-1114470276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:16:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-99004735-d522-4151-9cc3-9ec813d15bd8 req-32d1ace2-da9d-4763-a61a-13fec83c6522 tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:16:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-99004735-d522-4151-9cc3-9ec813d15bd8 req-32d1ace2-da9d-4763-a61a-13fec83c6522 tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:16:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-99004735-d522-4151-9cc3-9ec813d15bd8 req-32d1ace2-da9d-4763-a61a-13fec83c6522 tempest-AttachVolumeTestJSON-1114470276 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-313a50ac-c730-4d98-8454-5dea99336985', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '150721ea-22b9-4026-ae66-7a88b04e210e', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:16:55 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-99004735-d522-4151-9cc3-9ec813d15bd8 req-32d1ace2-da9d-4763-a61a-13fec83c6522 tempest-AttachVolumeTestJSON-1114470276 None] attachment_update completed successfully.
Sep 16 16:16:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-72209778-283b-44fa-9f84-5f9d691543e8 tempest-VolumesCloneNegativeTest-281995381 None] Acquiring lock "cinder-485cd20c-049a-4965-a547-c35f7d2301f8-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:16:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-72209778-283b-44fa-9f84-5f9d691543e8 tempest-VolumesCloneNegativeTest-281995381 None] Lock "cinder-485cd20c-049a-4965-a547-c35f7d2301f8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:16:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-72209778-283b-44fa-9f84-5f9d691543e8 tempest-VolumesCloneNegativeTest-281995381 None] Acquiring lock "cinder-quobyte-485cd20c-049a-4965-a547-c35f7d2301f8" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:16:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-72209778-283b-44fa-9f84-5f9d691543e8 tempest-VolumesCloneNegativeTest-281995381 None] Lock "cinder-quobyte-485cd20c-049a-4965-a547-c35f7d2301f8" acquired by "delete_volume" :: waited 0.028s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:16:55 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f78ee4-8fe1-4fa3-b0a9-8e06ef3d84c3]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:16:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-72209778-283b-44fa-9f84-5f9d691543e8 tempest-VolumesCloneNegativeTest-281995381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-485cd20c-049a-4965-a547-c35f7d2301f8 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:55 devstack sudo[96918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-485cd20c-049a-4965-a547-c35f7d2301f8
Sep 16 16:16:55 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:56 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-72209778-283b-44fa-9f84-5f9d691543e8 tempest-VolumesCloneNegativeTest-281995381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-485cd20c-049a-4965-a547-c35f7d2301f8" returned: 0 in 0.510s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-72209778-283b-44fa-9f84-5f9d691543e8 tempest-VolumesCloneNegativeTest-281995381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-485cd20c-049a-4965-a547-c35f7d2301f8 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:56 devstack sudo[96923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-485cd20c-049a-4965-a547-c35f7d2301f8
Sep 16 16:16:56 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:56 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-72209778-283b-44fa-9f84-5f9d691543e8 tempest-VolumesCloneNegativeTest-281995381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-485cd20c-049a-4965-a547-c35f7d2301f8" returned: 0 in 0.342s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:56 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-72209778-283b-44fa-9f84-5f9d691543e8 tempest-VolumesCloneNegativeTest-281995381 None] Lock "cinder-quobyte-485cd20c-049a-4965-a547-c35f7d2301f8" released by "delete_volume" :: held 0.921s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:16:56 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-72209778-283b-44fa-9f84-5f9d691543e8 tempest-VolumesCloneNegativeTest-281995381 None] Created reservations ['97950011-257d-43d7-b57f-eb39278f6e90', '6844b460-8b52-448f-a994-2e8dd7866eb4', 'd77ace5b-a1ef-498a-a397-6ac73a19fa35', 'de035ea1-6dd3-4353-b5db-5b6063f12507'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:16:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-72209778-283b-44fa-9f84-5f9d691543e8 tempest-VolumesCloneNegativeTest-281995381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:16:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-72209778-283b-44fa-9f84-5f9d691543e8 tempest-VolumesCloneNegativeTest-281995381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:16:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-72209778-283b-44fa-9f84-5f9d691543e8 tempest-VolumesCloneNegativeTest-281995381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:16:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-72209778-283b-44fa-9f84-5f9d691543e8 tempest-VolumesCloneNegativeTest-281995381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:16:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-72209778-283b-44fa-9f84-5f9d691543e8 tempest-VolumesCloneNegativeTest-281995381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:16:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-72209778-283b-44fa-9f84-5f9d691543e8 tempest-VolumesCloneNegativeTest-281995381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:16:56 devstack sudo[96926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:16:56 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:16:56 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root
Sep 16 16:16:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-72209778-283b-44fa-9f84-5f9d691543e8 tempest-VolumesCloneNegativeTest-281995381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.328s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:16:56 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-72209778-283b-44fa-9f84-5f9d691543e8 tempest-VolumesCloneNegativeTest-281995381 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:16:56 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-72209778-283b-44fa-9f84-5f9d691543e8 tempest-VolumesCloneNegativeTest-281995381 None] Deleted volume successfully.
Sep 16 16:16:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-72209778-283b-44fa-9f84-5f9d691543e8 tempest-VolumesCloneNegativeTest-281995381 None] Lock "cinder-485cd20c-049a-4965-a547-c35f7d2301f8-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:17:01 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-2ccc930f-11e5-4329-a5ef-82ba96653b29 req-a20c1e2f-a092-43a5-a677-a21018448695 tempest-AttachVolumeTestJSON-1114470276 None] Terminate volume connection completed successfully.
Sep 16 16:17:01 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-2ccc930f-11e5-4329-a5ef-82ba96653b29 req-a20c1e2f-a092-43a5-a677-a21018448695 tempest-AttachVolumeTestJSON-1114470276 None] Deleting attachment d9eb0fd0-8771-4655-9d92-48d4f1cb40b6. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:17:05 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-5e583a07-046d-4f5f-9e8c-9a5fec34e360 req-fed0bc37-1764-45cf-8756-be05451c5c71 tempest-AttachVolumeTestJSON-1114470276 None] Terminate volume connection completed successfully.
Sep 16 16:17:05 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-5e583a07-046d-4f5f-9e8c-9a5fec34e360 req-fed0bc37-1764-45cf-8756-be05451c5c71 tempest-AttachVolumeTestJSON-1114470276 None] Deleting attachment 150721ea-22b9-4026-ae66-7a88b04e210e. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:17:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:17:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:17:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:17:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:17:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:17:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:17:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:07 devstack sudo[97030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:17:07 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:07 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.626s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:17:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:17:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 28 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:17:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>, <Thread(tpool_thread_0, started daemon 135438770624192)>, <Thread(tpool_thread_1, started daemon 135438762231488)>, <Thread(tpool_thread_2, started daemon 135438753838784)>, <Thread(tpool_thread_3, started daemon 135438745446080)>, <Thread(tpool_thread_4, started daemon 135438737053376)>, <Thread(tpool_thread_5, started daemon 135438728660672)>, <Thread(tpool_thread_6, started daemon 135438720267968)>, <Thread(tpool_thread_7, started daemon 135438711875264)>, <Thread(tpool_thread_8, started daemon 135438703466176)>, <Thread(tpool_thread_9, started daemon 135438695057088)>, <Thread(tpool_thread_10, started daemon 135438686648000)>, <Thread(tpool_thread_11, started daemon 135438678238912)>, <Thread(tpool_thread_12, started daemon 135438669829824)>, <Thread(tpool_thread_13, started daemon 135438661420736)>, <Thread(tpool_thread_14, started daemon 135438653011648)>, <Thread(tpool_thread_15, started daemon 135438644602560)>, <Thread(tpool_thread_16, started daemon 135438636193472)>, <Thread(tpool_thread_17, started daemon 135438627784384)>, <Thread(tpool_thread_18, started daemon 135438619375296)>, <Thread(tpool_thread_19, started daemon 135438610966208)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:17:09 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:17:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Flow 'volume_create_manager' (8da56dd6-6202-481e-b7cd-171c0577fad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:17:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9e9d45e-431d-46b9-b1fa-5dc7a0801163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:17:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9e9d45e-431d-46b9-b1fa-5dc7a0801163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-909048581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe1eb287-ef64-48e8-9c76-b068a26b3e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ecff067d1e4c47991992afb2b1710f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:17:10Z,use_quota=True,user_id='ffbcfa0f2a2d445ba46f947d2ec3aa9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:17:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17682b12-d29d-4ea5-a154-df818b990a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:17:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17682b12-d29d-4ea5-a154-df818b990a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:17:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec5cea46-9126-457b-8574-09bfc7f6ddaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:17:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec5cea46-9126-457b-8574-09bfc7f6ddaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe1eb287-ef64-48e8-9c76-b068a26b3e2e', 'volume_name': 'volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:17:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29ece69-39ec-43d0-b9a2-b1b451967ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:17:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29ece69-39ec-43d0-b9a2-b1b451967ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:17:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce265bb4-9748-46e7-95d2-6155ac21d532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:17:09 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Volume fe1eb287-ef64-48e8-9c76-b068a26b3e2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e', 'volume_size': 1}
Sep 16 16:17:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:17:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:17:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-909048581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe1eb287-ef64-48e8-9c76-b068a26b3e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ecff067d1e4c47991992afb2b1710f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:17:10Z,use_quota=True,user_id='ffbcfa0f2a2d445ba46f947d2ec3aa9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:17:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Creating volume fe1eb287-ef64-48e8-9c76-b068a26b3e2e {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:17:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:17:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:17:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:17:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:17:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:17:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:17:09 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:17:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:09 devstack sudo[97052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e 1073741824
Sep 16 16:17:09 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:10 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e 1073741824" returned: 0 in 0.567s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:10 devstack sudo[97059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e
Sep 16 16:17:10 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:10 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e" returned: 0 in 0.369s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:17:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:17:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce265bb4-9748-46e7-95d2-6155ac21d532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:17:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096165b1-1b3b-43bf-a1e2-1e1d4f777d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:17:10 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Volume volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e (fe1eb287-ef64-48e8-9c76-b068a26b3e2e): created successfully
Sep 16 16:17:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (096165b1-1b3b-43bf-a1e2-1e1d4f777d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:17:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Flow 'volume_create_manager' (8da56dd6-6202-481e-b7cd-171c0577fad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:17:10 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-6438997d-817f-4d41-b1a3-e3f2aa2c8581 tempest-VolumesSnapshotListTestJSON-504997350 None] Created volume successfully.
Sep 16 16:17:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6c56728f-dab5-4330-a753-e50972e04ed2 tempest-VolumesSnapshotListTestJSON-504997350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:17:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6c56728f-dab5-4330-a753-e50972e04ed2 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:17:12 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=57,cinder:INSERT=19,cinder:UPDATE=50,cinder:DELETE=6 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:17:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-6c56728f-dab5-4330-a753-e50972e04ed2 tempest-VolumesSnapshotListTestJSON-504997350 None] Creating offline snapshot 3c71a14d-6371-4180-b717-6cab19ae6b8d of volume fe1eb287-ef64-48e8-9c76-b068a26b3e2e {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:17:12 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6f1e8e-d1e4-45e7-87ef-b340aae289e6]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:17:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6c56728f-dab5-4330-a753-e50972e04ed2 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:12 devstack sudo[97066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e
Sep 16 16:17:12 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:12 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6c56728f-dab5-4330-a753-e50972e04ed2 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e" returned: 0 in 0.561s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6c56728f-dab5-4330-a753-e50972e04ed2 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:12 devstack sudo[97077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d 1G
Sep 16 16:17:12 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:13 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6c56728f-dab5-4330-a753-e50972e04ed2 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d 1G" returned: 0 in 0.549s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6c56728f-dab5-4330-a753-e50972e04ed2 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:13 devstack sudo[97086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d
Sep 16 16:17:13 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:13 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6c56728f-dab5-4330-a753-e50972e04ed2 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d" returned: 0 in 0.616s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:13 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-6c56728f-dab5-4330-a753-e50972e04ed2 tempest-VolumesSnapshotListTestJSON-504997350 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d is being set with open permissions: ugo+rw
Sep 16 16:17:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6c56728f-dab5-4330-a753-e50972e04ed2 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:13 devstack sudo[97108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d
Sep 16 16:17:13 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:13 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=59,cinder:UPDATE=48,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:17:13 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-3629cabc-1aff-456c-94db-604c4b8fc5e5 req-f56a5123-c7a2-4d74-8f2c-8be1894f42b0 tempest-TestShelveInstance-1732648310 None] Terminate volume connection completed successfully.
Sep 16 16:17:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-3629cabc-1aff-456c-94db-604c4b8fc5e5 req-f56a5123-c7a2-4d74-8f2c-8be1894f42b0 tempest-TestShelveInstance-1732648310 None] Deleting attachment d4239df3-bb7d-41fc-99a2-25ca0cae26b2. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:17:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-75887271-68e5-46d8-8085-0cf4e8c9ad8c tempest-AttachVolumeTestJSON-1114470276 None] Acquiring lock "cinder-313a50ac-c730-4d98-8454-5dea99336985-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:17:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-75887271-68e5-46d8-8085-0cf4e8c9ad8c tempest-AttachVolumeTestJSON-1114470276 None] Lock "cinder-313a50ac-c730-4d98-8454-5dea99336985-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:17:14 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6c56728f-dab5-4330-a753-e50972e04ed2 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d" returned: 0 in 0.440s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-75887271-68e5-46d8-8085-0cf4e8c9ad8c tempest-AttachVolumeTestJSON-1114470276 None] Acquiring lock "cinder-quobyte-313a50ac-c730-4d98-8454-5dea99336985" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:17:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-75887271-68e5-46d8-8085-0cf4e8c9ad8c tempest-AttachVolumeTestJSON-1114470276 None] Lock "cinder-quobyte-313a50ac-c730-4d98-8454-5dea99336985" acquired by "delete_volume" :: waited 0.042s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:17:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6c56728f-dab5-4330-a753-e50972e04ed2 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:14 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cd0f6f-786e-48cb-84c5-574608d3a99f]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:17:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-75887271-68e5-46d8-8085-0cf4e8c9ad8c tempest-AttachVolumeTestJSON-1114470276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-313a50ac-c730-4d98-8454-5dea99336985 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:14 devstack sudo[97111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.info
Sep 16 16:17:14 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:14 devstack sudo[97112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-313a50ac-c730-4d98-8454-5dea99336985
Sep 16 16:17:14 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:14 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6c56728f-dab5-4330-a753-e50972e04ed2 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.info" returned: 0 in 0.337s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:14 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-6c56728f-dab5-4330-a753-e50972e04ed2 tempest-VolumesSnapshotListTestJSON-504997350 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.info is being set with open permissions: ugo+rw
Sep 16 16:17:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6c56728f-dab5-4330-a753-e50972e04ed2 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:14 devstack sudo[97116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.info
Sep 16 16:17:14 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:14 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-75887271-68e5-46d8-8085-0cf4e8c9ad8c tempest-AttachVolumeTestJSON-1114470276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-313a50ac-c730-4d98-8454-5dea99336985" returned: 0 in 0.515s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-75887271-68e5-46d8-8085-0cf4e8c9ad8c tempest-AttachVolumeTestJSON-1114470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-313a50ac-c730-4d98-8454-5dea99336985 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:15 devstack sudo[97121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-313a50ac-c730-4d98-8454-5dea99336985
Sep 16 16:17:15 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:15 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6c56728f-dab5-4330-a753-e50972e04ed2 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.info" returned: 0 in 0.262s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6c56728f-dab5-4330-a753-e50972e04ed2 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:17:15 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-6c56728f-dab5-4330-a753-e50972e04ed2 tempest-VolumesSnapshotListTestJSON-504997350 None] Create snapshot completed successfully
Sep 16 16:17:15 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-75887271-68e5-46d8-8085-0cf4e8c9ad8c tempest-AttachVolumeTestJSON-1114470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-313a50ac-c730-4d98-8454-5dea99336985" returned: 0 in 0.324s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-75887271-68e5-46d8-8085-0cf4e8c9ad8c tempest-AttachVolumeTestJSON-1114470276 None] Lock "cinder-quobyte-313a50ac-c730-4d98-8454-5dea99336985" released by "delete_volume" :: held 0.937s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:17:15 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-75887271-68e5-46d8-8085-0cf4e8c9ad8c tempest-AttachVolumeTestJSON-1114470276 None] Created reservations ['3bdacd4d-0a4b-41dd-855d-c230eaac3ef3', '7aa00011-ad66-4e0d-bf5b-54f0f3956d10', '476a71e8-29cf-403d-9ef3-61b651774822', 'b93c6b49-757e-44c1-9126-b930e69f1b28'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:17:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-29c0ad30-b3cf-4650-ae1a-3b55f5f99918 tempest-VolumesSnapshotListTestJSON-504997350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:17:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-29c0ad30-b3cf-4650-ae1a-3b55f5f99918 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:17:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-29c0ad30-b3cf-4650-ae1a-3b55f5f99918 tempest-VolumesSnapshotListTestJSON-504997350 None] Creating offline snapshot 1eb8100f-5903-4e7d-9e97-743c7359887b of volume fe1eb287-ef64-48e8-9c76-b068a26b3e2e {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:17:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-75887271-68e5-46d8-8085-0cf4e8c9ad8c tempest-AttachVolumeTestJSON-1114470276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:17:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-75887271-68e5-46d8-8085-0cf4e8c9ad8c tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:17:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-75887271-68e5-46d8-8085-0cf4e8c9ad8c tempest-AttachVolumeTestJSON-1114470276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:17:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-75887271-68e5-46d8-8085-0cf4e8c9ad8c tempest-AttachVolumeTestJSON-1114470276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:17:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-75887271-68e5-46d8-8085-0cf4e8c9ad8c tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:17:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-75887271-68e5-46d8-8085-0cf4e8c9ad8c tempest-AttachVolumeTestJSON-1114470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:15 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad063e68-cd4d-4d76-8a27-564508bca81d]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:17:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29c0ad30-b3cf-4650-ae1a-3b55f5f99918 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:15 devstack sudo[97127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:17:15 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:15 devstack sudo[97128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d
Sep 16 16:17:15 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:16 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-75887271-68e5-46d8-8085-0cf4e8c9ad8c tempest-AttachVolumeTestJSON-1114470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.394s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:16 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-75887271-68e5-46d8-8085-0cf4e8c9ad8c tempest-AttachVolumeTestJSON-1114470276 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:17:16 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-75887271-68e5-46d8-8085-0cf4e8c9ad8c tempest-AttachVolumeTestJSON-1114470276 None] Deleted volume successfully.
Sep 16 16:17:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-75887271-68e5-46d8-8085-0cf4e8c9ad8c tempest-AttachVolumeTestJSON-1114470276 None] Lock "cinder-313a50ac-c730-4d98-8454-5dea99336985-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:17:16 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29c0ad30-b3cf-4650-ae1a-3b55f5f99918 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d" returned: 0 in 0.507s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-29c0ad30-b3cf-4650-ae1a-3b55f5f99918 tempest-VolumesSnapshotListTestJSON-504997350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:17:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29c0ad30-b3cf-4650-ae1a-3b55f5f99918 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:16 devstack sudo[97137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b 1G
Sep 16 16:17:16 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9b8406cd-9961-4f40-a057-7a7815faaef7 tempest-AttachVolumeTestJSON-1114470276 None] Acquiring lock "cinder-1661976f-c19d-4e9c-91d7-9974e9493cd1-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:17:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9b8406cd-9961-4f40-a057-7a7815faaef7 tempest-AttachVolumeTestJSON-1114470276 None] Lock "cinder-1661976f-c19d-4e9c-91d7-9974e9493cd1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:17:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9b8406cd-9961-4f40-a057-7a7815faaef7 tempest-AttachVolumeTestJSON-1114470276 None] Acquiring lock "cinder-quobyte-1661976f-c19d-4e9c-91d7-9974e9493cd1" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:17:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9b8406cd-9961-4f40-a057-7a7815faaef7 tempest-AttachVolumeTestJSON-1114470276 None] Lock "cinder-quobyte-1661976f-c19d-4e9c-91d7-9974e9493cd1" acquired by "delete_volume" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:17:16 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3538ac-3457-49bd-a0b9-56172caa8523]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:17:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b8406cd-9961-4f40-a057-7a7815faaef7 tempest-AttachVolumeTestJSON-1114470276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1661976f-c19d-4e9c-91d7-9974e9493cd1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:16 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29c0ad30-b3cf-4650-ae1a-3b55f5f99918 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b 1G" returned: 0 in 0.664s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29c0ad30-b3cf-4650-ae1a-3b55f5f99918 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:16 devstack sudo[97144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1661976f-c19d-4e9c-91d7-9974e9493cd1
Sep 16 16:17:16 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:16 devstack sudo[97145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b
Sep 16 16:17:16 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:17 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b8406cd-9961-4f40-a057-7a7815faaef7 tempest-AttachVolumeTestJSON-1114470276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1661976f-c19d-4e9c-91d7-9974e9493cd1" returned: 0 in 0.542s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b8406cd-9961-4f40-a057-7a7815faaef7 tempest-AttachVolumeTestJSON-1114470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1661976f-c19d-4e9c-91d7-9974e9493cd1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:17 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29c0ad30-b3cf-4650-ae1a-3b55f5f99918 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b" returned: 0 in 0.386s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:17 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-29c0ad30-b3cf-4650-ae1a-3b55f5f99918 tempest-VolumesSnapshotListTestJSON-504997350 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b is being set with open permissions: ugo+rw
Sep 16 16:17:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29c0ad30-b3cf-4650-ae1a-3b55f5f99918 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:17 devstack sudo[97154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1661976f-c19d-4e9c-91d7-9974e9493cd1
Sep 16 16:17:17 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:17 devstack sudo[97155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b
Sep 16 16:17:17 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:17 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29c0ad30-b3cf-4650-ae1a-3b55f5f99918 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b" returned: 0 in 0.304s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:17 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b8406cd-9961-4f40-a057-7a7815faaef7 tempest-AttachVolumeTestJSON-1114470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1661976f-c19d-4e9c-91d7-9974e9493cd1" returned: 0 in 0.339s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-29c0ad30-b3cf-4650-ae1a-3b55f5f99918 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.058s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:17:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9b8406cd-9961-4f40-a057-7a7815faaef7 tempest-AttachVolumeTestJSON-1114470276 None] Lock "cinder-quobyte-1661976f-c19d-4e9c-91d7-9974e9493cd1" released by "delete_volume" :: held 0.976s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:17:17 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-29c0ad30-b3cf-4650-ae1a-3b55f5f99918 tempest-VolumesSnapshotListTestJSON-504997350 None] Create snapshot completed successfully
Sep 16 16:17:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-f4ae3acc-c4dc-46a4-a990-24c571163213 req-88cfa84c-a0be-4542-836b-3dcdeb4cbf32 tempest-TestShelveInstance-1732648310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:17:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-f4ae3acc-c4dc-46a4-a990-24c571163213 req-88cfa84c-a0be-4542-836b-3dcdeb4cbf32 tempest-TestShelveInstance-1732648310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:17:17 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-9b8406cd-9961-4f40-a057-7a7815faaef7 tempest-AttachVolumeTestJSON-1114470276 None] Created reservations ['d54c6852-7500-4053-b22a-f5be38736c3c', '0cad8c75-2091-4270-9e5f-1883f1937a62', '34f8aeab-8878-4bae-8289-31432cfcbb84', 'a8ad767a-8f4f-442a-bc28-70c2ab2665f5'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:17:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-f4ae3acc-c4dc-46a4-a990-24c571163213 req-88cfa84c-a0be-4542-836b-3dcdeb4cbf32 tempest-TestShelveInstance-1732648310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:17:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-f4ae3acc-c4dc-46a4-a990-24c571163213 req-88cfa84c-a0be-4542-836b-3dcdeb4cbf32 tempest-TestShelveInstance-1732648310 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aeb6a393-caf8-4926-b8dd-2f079aeff17c', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:17:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9b8406cd-9961-4f40-a057-7a7815faaef7 tempest-AttachVolumeTestJSON-1114470276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:17:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9b8406cd-9961-4f40-a057-7a7815faaef7 tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:17:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9b8406cd-9961-4f40-a057-7a7815faaef7 tempest-AttachVolumeTestJSON-1114470276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9b8406cd-9961-4f40-a057-7a7815faaef7 tempest-AttachVolumeTestJSON-1114470276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9b8406cd-9961-4f40-a057-7a7815faaef7 tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b8406cd-9961-4f40-a057-7a7815faaef7 tempest-AttachVolumeTestJSON-1114470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:18 devstack sudo[97168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:17:18 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Flow 'volume_create_manager' (4cbec45d-86f3-44d9-9472-3732e1ba0bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac72f7c-7d0f-4fea-b466-14e1376f3568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac72f7c-7d0f-4fea-b466-14e1376f3568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-475320056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117a963f-d658-4f2b-8f8a-4947c505277c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602a321c3e75412c808c107c7a17823e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:17:18Z,use_quota=True,user_id='d1cb8e46ac4d4ee9ade2646dc37eb079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b87df77-78c2-4cb0-ba5f-5d5f07eb2465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b87df77-78c2-4cb0-ba5f-5d5f07eb2465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20adead2-e2c4-4bf3-9091-f5d8746211fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20adead2-e2c4-4bf3-9091-f5d8746211fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '117a963f-d658-4f2b-8f8a-4947c505277c', 'volume_name': 'volume-117a963f-d658-4f2b-8f8a-4947c505277c', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267a0bc9-d951-4237-97db-1291536c315d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267a0bc9-d951-4237-97db-1291536c315d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb3b1cf-dca0-461b-b697-56af33134c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:17:18 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Volume 117a963f-d658-4f2b-8f8a-4947c505277c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-117a963f-d658-4f2b-8f8a-4947c505277c', 'volume_size': 1}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-475320056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117a963f-d658-4f2b-8f8a-4947c505277c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602a321c3e75412c808c107c7a17823e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:17:18Z,use_quota=True,user_id='d1cb8e46ac4d4ee9ade2646dc37eb079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Creating volume 117a963f-d658-4f2b-8f8a-4947c505277c {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:17:18 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:18 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b8406cd-9961-4f40-a057-7a7815faaef7 tempest-AttachVolumeTestJSON-1114470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.325s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-9b8406cd-9961-4f40-a057-7a7815faaef7 tempest-AttachVolumeTestJSON-1114470276 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:17:18 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-f4ae3acc-c4dc-46a4-a990-24c571163213 req-88cfa84c-a0be-4542-836b-3dcdeb4cbf32 tempest-TestShelveInstance-1732648310 None] attachment_update completed successfully.
Sep 16 16:17:18 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-9b8406cd-9961-4f40-a057-7a7815faaef7 tempest-AttachVolumeTestJSON-1114470276 None] Deleted volume successfully.
Sep 16 16:17:18 devstack sudo[97171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c 1073741824
Sep 16 16:17:18 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-054fa6f2-8141-4e9c-8bbf-600bfb78e15a tempest-VolumesSnapshotListTestJSON-504997350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9b8406cd-9961-4f40-a057-7a7815faaef7 tempest-AttachVolumeTestJSON-1114470276 None] Lock "cinder-1661976f-c19d-4e9c-91d7-9974e9493cd1-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:17:18 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c 1073741824" returned: 0 in 0.581s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:18 devstack sudo[97177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c
Sep 16 16:17:18 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f474747e-0dd2-45a4-b168-c782c603cdb6 tempest-AttachVolumeTestJSON-1114470276 None] Acquiring lock "cinder-e611585f-09f8-4268-88e1-e1c5979fa2a8-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:17:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f474747e-0dd2-45a4-b168-c782c603cdb6 tempest-AttachVolumeTestJSON-1114470276 None] Lock "cinder-e611585f-09f8-4268-88e1-e1c5979fa2a8-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:17:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f474747e-0dd2-45a4-b168-c782c603cdb6 tempest-AttachVolumeTestJSON-1114470276 None] Acquiring lock "cinder-quobyte-e611585f-09f8-4268-88e1-e1c5979fa2a8" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:17:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f474747e-0dd2-45a4-b168-c782c603cdb6 tempest-AttachVolumeTestJSON-1114470276 None] Lock "cinder-quobyte-e611585f-09f8-4268-88e1-e1c5979fa2a8" acquired by "delete_volume" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:17:19 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c" returned: 0 in 0.355s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:17:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:17:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-054fa6f2-8141-4e9c-8bbf-600bfb78e15a tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.939s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:17:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb3b1cf-dca0-461b-b697-56af33134c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117a963f-d658-4f2b-8f8a-4947c505277c', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:17:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3473d1e6-dd4a-4ed6-b497-29193e546fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:17:19 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[370a1271-0b61-44d4-85dc-52cbb62db797]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:17:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f474747e-0dd2-45a4-b168-c782c603cdb6 tempest-AttachVolumeTestJSON-1114470276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e611585f-09f8-4268-88e1-e1c5979fa2a8 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-054fa6f2-8141-4e9c-8bbf-600bfb78e15a tempest-VolumesSnapshotListTestJSON-504997350 None] Creating offline snapshot 95b91992-6577-4cbc-be44-8dca371187e4 of volume fe1eb287-ef64-48e8-9c76-b068a26b3e2e {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:17:19 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eeaf0d3-7371-4620-a009-b9bae637cdbc]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:17:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-054fa6f2-8141-4e9c-8bbf-600bfb78e15a tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:19 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Volume volume-117a963f-d658-4f2b-8f8a-4947c505277c (117a963f-d658-4f2b-8f8a-4947c505277c): created successfully
Sep 16 16:17:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3473d1e6-dd4a-4ed6-b497-29193e546fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:17:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Flow 'volume_create_manager' (4cbec45d-86f3-44d9-9472-3732e1ba0bfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:17:19 devstack sudo[97183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e611585f-09f8-4268-88e1-e1c5979fa2a8
Sep 16 16:17:19 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:19 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-4ef677cc-5095-4316-b857-f3046875dd14 tempest-TestStampPattern-1514829522 None] Created volume successfully.
Sep 16 16:17:19 devstack sudo[97184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b
Sep 16 16:17:19 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:19 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f474747e-0dd2-45a4-b168-c782c603cdb6 tempest-AttachVolumeTestJSON-1114470276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e611585f-09f8-4268-88e1-e1c5979fa2a8" returned: 0 in 0.584s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f474747e-0dd2-45a4-b168-c782c603cdb6 tempest-AttachVolumeTestJSON-1114470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e611585f-09f8-4268-88e1-e1c5979fa2a8 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:19 devstack sudo[97193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e611585f-09f8-4268-88e1-e1c5979fa2a8
Sep 16 16:17:19 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:19 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-054fa6f2-8141-4e9c-8bbf-600bfb78e15a tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b" returned: 0 in 0.545s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-054fa6f2-8141-4e9c-8bbf-600bfb78e15a tempest-VolumesSnapshotListTestJSON-504997350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:17:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-054fa6f2-8141-4e9c-8bbf-600bfb78e15a tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.95b91992-6577-4cbc-be44-8dca371187e4 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:20 devstack sudo[97195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.95b91992-6577-4cbc-be44-8dca371187e4 1G
Sep 16 16:17:20 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:20 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f474747e-0dd2-45a4-b168-c782c603cdb6 tempest-AttachVolumeTestJSON-1114470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e611585f-09f8-4268-88e1-e1c5979fa2a8" returned: 0 in 0.322s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:20 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f474747e-0dd2-45a4-b168-c782c603cdb6 tempest-AttachVolumeTestJSON-1114470276 None] Lock "cinder-quobyte-e611585f-09f8-4268-88e1-e1c5979fa2a8" released by "delete_volume" :: held 1.001s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:17:20 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-f474747e-0dd2-45a4-b168-c782c603cdb6 tempest-AttachVolumeTestJSON-1114470276 None] Created reservations ['0f27a2fc-42fe-4d79-838e-458b3758ce86', 'eced3098-2259-485c-b418-60d85f57d594', '31ab062e-5f64-4d68-8a85-1d9b5e42f5cf', '21d31dba-d3c4-4d8c-85b5-380df380320f'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:17:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f474747e-0dd2-45a4-b168-c782c603cdb6 tempest-AttachVolumeTestJSON-1114470276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:17:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f474747e-0dd2-45a4-b168-c782c603cdb6 tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:17:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-f474747e-0dd2-45a4-b168-c782c603cdb6 tempest-AttachVolumeTestJSON-1114470276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:17:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-f474747e-0dd2-45a4-b168-c782c603cdb6 tempest-AttachVolumeTestJSON-1114470276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:17:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f474747e-0dd2-45a4-b168-c782c603cdb6 tempest-AttachVolumeTestJSON-1114470276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:17:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f474747e-0dd2-45a4-b168-c782c603cdb6 tempest-AttachVolumeTestJSON-1114470276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:20 devstack sudo[97203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:17:20 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:20 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-054fa6f2-8141-4e9c-8bbf-600bfb78e15a tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.95b91992-6577-4cbc-be44-8dca371187e4 1G" returned: 0 in 0.743s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-054fa6f2-8141-4e9c-8bbf-600bfb78e15a tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.95b91992-6577-4cbc-be44-8dca371187e4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:20 devstack sudo[97206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.95b91992-6577-4cbc-be44-8dca371187e4
Sep 16 16:17:20 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:20 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f474747e-0dd2-45a4-b168-c782c603cdb6 tempest-AttachVolumeTestJSON-1114470276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.364s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:20 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-f474747e-0dd2-45a4-b168-c782c603cdb6 tempest-AttachVolumeTestJSON-1114470276 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:17:20 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-f474747e-0dd2-45a4-b168-c782c603cdb6 tempest-AttachVolumeTestJSON-1114470276 None] Deleted volume successfully.
Sep 16 16:17:20 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f474747e-0dd2-45a4-b168-c782c603cdb6 tempest-AttachVolumeTestJSON-1114470276 None] Lock "cinder-e611585f-09f8-4268-88e1-e1c5979fa2a8-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:17:21 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-054fa6f2-8141-4e9c-8bbf-600bfb78e15a tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.95b91992-6577-4cbc-be44-8dca371187e4" returned: 0 in 0.451s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:21 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-054fa6f2-8141-4e9c-8bbf-600bfb78e15a tempest-VolumesSnapshotListTestJSON-504997350 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.95b91992-6577-4cbc-be44-8dca371187e4 is being set with open permissions: ugo+rw
Sep 16 16:17:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-054fa6f2-8141-4e9c-8bbf-600bfb78e15a tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.95b91992-6577-4cbc-be44-8dca371187e4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:21 devstack sudo[97217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.95b91992-6577-4cbc-be44-8dca371187e4
Sep 16 16:17:21 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:21 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-054fa6f2-8141-4e9c-8bbf-600bfb78e15a tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.95b91992-6577-4cbc-be44-8dca371187e4" returned: 0 in 0.454s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-054fa6f2-8141-4e9c-8bbf-600bfb78e15a tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.414s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:17:21 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-054fa6f2-8141-4e9c-8bbf-600bfb78e15a tempest-VolumesSnapshotListTestJSON-504997350 None] Create snapshot completed successfully
Sep 16 16:17:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] Acquiring lock "cinder-95b91992-6577-4cbc-be44-8dca371187e4-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:17:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "cinder-95b91992-6577-4cbc-be44-8dca371187e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:17:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] Acquiring lock "cinder-quobyte-fe1eb287-ef64-48e8-9c76-b068a26b3e2e" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:17:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "cinder-quobyte-fe1eb287-ef64-48e8-9c76-b068a26b3e2e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:17:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] Acquiring lock "cinder-quobyte-95b91992-6577-4cbc-be44-8dca371187e4" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:17:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "cinder-quobyte-95b91992-6577-4cbc-be44-8dca371187e4" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:17:24 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] Deleting offline snapshot 95b91992-6577-4cbc-be44-8dca371187e4 of volume fe1eb287-ef64-48e8-9c76-b068a26b3e2e {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:17:24 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] snapshot_file for this snap is: volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.95b91992-6577-4cbc-be44-8dca371187e4 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:17:24 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3106f82d-aba6-4c55-a181-481263a0ff66]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:17:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.95b91992-6577-4cbc-be44-8dca371187e4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:24 devstack sudo[97707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.95b91992-6577-4cbc-be44-8dca371187e4
Sep 16 16:17:24 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:25 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.95b91992-6577-4cbc-be44-8dca371187e4" returned: 0 in 0.750s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:17:25 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04f7822-56d0-451b-bacd-9e257d119de2]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:17:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:25 devstack sudo[97716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b
Sep 16 16:17:25 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b" returned: 0 in 0.627s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:17:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.95b91992-6577-4cbc-be44-8dca371187e4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:25 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:25 devstack sudo[97721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.95b91992-6577-4cbc-be44-8dca371187e4
Sep 16 16:17:25 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:27 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.95b91992-6577-4cbc-be44-8dca371187e4" returned: 0 in 1.398s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.95b91992-6577-4cbc-be44-8dca371187e4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:27 devstack sudo[97777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.95b91992-6577-4cbc-be44-8dca371187e4
Sep 16 16:17:27 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:27 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.95b91992-6577-4cbc-be44-8dca371187e4" returned: 0 in 0.358s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:27 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "cinder-quobyte-95b91992-6577-4cbc-be44-8dca371187e4" released by "_delete_snapshot" :: held 3.340s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:17:27 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "cinder-quobyte-fe1eb287-ef64-48e8-9c76-b068a26b3e2e" released by "delete_snapshot" :: held 3.397s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:17:27 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] Created reservations ['27adf5f0-b88d-4e32-bba3-614426b735e4', 'e75c976a-b206-45ad-9bc2-00574289b3a1', '13198dfd-ec9b-4d9c-a881-43dd7f3d55cf', 'ce9197bc-377c-4d34-bf0d-4c50bc5a2b8c'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:17:27 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] Delete snapshot completed successfully.
Sep 16 16:17:27 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9e3be2f2-f2b4-48e8-bf24-35d1f9562c5c tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "cinder-95b91992-6577-4cbc-be44-8dca371187e4-delete_snapshot" released by "delete_snapshot" :: held 3.701s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:17:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] Acquiring lock "cinder-1eb8100f-5903-4e7d-9e97-743c7359887b-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:17:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "cinder-1eb8100f-5903-4e7d-9e97-743c7359887b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:17:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] Acquiring lock "cinder-quobyte-fe1eb287-ef64-48e8-9c76-b068a26b3e2e" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:17:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "cinder-quobyte-fe1eb287-ef64-48e8-9c76-b068a26b3e2e" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:17:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] Acquiring lock "cinder-quobyte-1eb8100f-5903-4e7d-9e97-743c7359887b" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:17:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "cinder-quobyte-1eb8100f-5903-4e7d-9e97-743c7359887b" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:17:28 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] Deleting offline snapshot 1eb8100f-5903-4e7d-9e97-743c7359887b of volume fe1eb287-ef64-48e8-9c76-b068a26b3e2e {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:17:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] snapshot_file for this snap is: volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:17:29 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb2e914-2bf5-458b-9a12-cb41339636f7]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:17:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:29 devstack sudo[97790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b
Sep 16 16:17:29 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:29 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b" returned: 0 in 0.742s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:17:29 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a659602-438f-4c4b-b7bc-8643fb2af9f1]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:17:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:30 devstack sudo[97796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d
Sep 16 16:17:30 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:30 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d" returned: 0 in 0.580s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:30 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:17:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:30 devstack sudo[97803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b
Sep 16 16:17:30 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:31 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b" returned: 0 in 0.725s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:31 devstack sudo[97810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b
Sep 16 16:17:31 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:31 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.1eb8100f-5903-4e7d-9e97-743c7359887b" returned: 0 in 0.319s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "cinder-quobyte-1eb8100f-5903-4e7d-9e97-743c7359887b" released by "_delete_snapshot" :: held 2.605s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:17:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "cinder-quobyte-fe1eb287-ef64-48e8-9c76-b068a26b3e2e" released by "delete_snapshot" :: held 2.674s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:17:31 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] Created reservations ['806c0e46-7394-4b34-b685-020f05d9bf37', 'b0be53fa-91b5-479a-91e7-6ae7b4864cf9', '5d29e390-8836-4f4d-aa01-7ef99b28af63', 'e53e94da-66c5-4952-8dc7-248ec6d00b07'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:17:31 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] Delete snapshot completed successfully.
Sep 16 16:17:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cfcfd8b3-b5a5-48d8-9e6f-8901965bf327 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "cinder-1eb8100f-5903-4e7d-9e97-743c7359887b-delete_snapshot" released by "delete_snapshot" :: held 3.044s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:17:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-38c236f0-ae02-4bf0-94dc-36fa93a73435 tempest-VolumesSnapshotListTestJSON-504997350 None] Acquiring lock "cinder-3c71a14d-6371-4180-b717-6cab19ae6b8d-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:17:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-38c236f0-ae02-4bf0-94dc-36fa93a73435 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "cinder-3c71a14d-6371-4180-b717-6cab19ae6b8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:17:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-38c236f0-ae02-4bf0-94dc-36fa93a73435 tempest-VolumesSnapshotListTestJSON-504997350 None] Acquiring lock "cinder-quobyte-fe1eb287-ef64-48e8-9c76-b068a26b3e2e" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:17:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-38c236f0-ae02-4bf0-94dc-36fa93a73435 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "cinder-quobyte-fe1eb287-ef64-48e8-9c76-b068a26b3e2e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:17:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-38c236f0-ae02-4bf0-94dc-36fa93a73435 tempest-VolumesSnapshotListTestJSON-504997350 None] Acquiring lock "cinder-quobyte-3c71a14d-6371-4180-b717-6cab19ae6b8d" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:17:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-38c236f0-ae02-4bf0-94dc-36fa93a73435 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "cinder-quobyte-3c71a14d-6371-4180-b717-6cab19ae6b8d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:17:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-38c236f0-ae02-4bf0-94dc-36fa93a73435 tempest-VolumesSnapshotListTestJSON-504997350 None] Deleting offline snapshot 3c71a14d-6371-4180-b717-6cab19ae6b8d of volume fe1eb287-ef64-48e8-9c76-b068a26b3e2e {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:17:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-38c236f0-ae02-4bf0-94dc-36fa93a73435 tempest-VolumesSnapshotListTestJSON-504997350 None] snapshot_file for this snap is: volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:17:32 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a74140d-f6bd-49eb-a1e5-e26dbed7eca3]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:17:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-38c236f0-ae02-4bf0-94dc-36fa93a73435 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:32 devstack sudo[97813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d
Sep 16 16:17:32 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:32 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-38c236f0-ae02-4bf0-94dc-36fa93a73435 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d" returned: 0 in 0.567s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-38c236f0-ae02-4bf0-94dc-36fa93a73435 tempest-VolumesSnapshotListTestJSON-504997350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:17:33 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05c4bfa-0050-4da4-9bae-96629c73dd40]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:17:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-38c236f0-ae02-4bf0-94dc-36fa93a73435 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:33 devstack sudo[97819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e
Sep 16 16:17:33 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:33 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-38c236f0-ae02-4bf0-94dc-36fa93a73435 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e" returned: 0 in 0.848s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-38c236f0-ae02-4bf0-94dc-36fa93a73435 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:33 devstack sudo[97824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d
Sep 16 16:17:33 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:34 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-38c236f0-ae02-4bf0-94dc-36fa93a73435 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d" returned: 0 in 0.529s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-38c236f0-ae02-4bf0-94dc-36fa93a73435 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:34 devstack sudo[97830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d
Sep 16 16:17:34 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:34 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-38c236f0-ae02-4bf0-94dc-36fa93a73435 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e.3c71a14d-6371-4180-b717-6cab19ae6b8d" returned: 0 in 0.394s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-38c236f0-ae02-4bf0-94dc-36fa93a73435 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "cinder-quobyte-3c71a14d-6371-4180-b717-6cab19ae6b8d" released by "_delete_snapshot" :: held 2.567s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:17:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-38c236f0-ae02-4bf0-94dc-36fa93a73435 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "cinder-quobyte-fe1eb287-ef64-48e8-9c76-b068a26b3e2e" released by "delete_snapshot" :: held 2.611s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:17:35 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-38c236f0-ae02-4bf0-94dc-36fa93a73435 tempest-VolumesSnapshotListTestJSON-504997350 None] Created reservations ['7a4b2bb8-a315-446a-b4e9-9b97f2b4bbf8', '6c378a61-7ab2-4064-aaa9-97c11a7b65c0', '8178468c-ad9f-4488-9a33-f9cce2fe774f', '41b9071a-3ffc-493f-81c7-17d84f61ac4b'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:17:35 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-38c236f0-ae02-4bf0-94dc-36fa93a73435 tempest-VolumesSnapshotListTestJSON-504997350 None] Delete snapshot completed successfully.
Sep 16 16:17:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-38c236f0-ae02-4bf0-94dc-36fa93a73435 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "cinder-3c71a14d-6371-4180-b717-6cab19ae6b8d-delete_snapshot" released by "delete_snapshot" :: held 2.881s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:17:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e0472909-178d-4ca7-9195-ce685f266715 tempest-VolumesSnapshotListTestJSON-504997350 None] Acquiring lock "cinder-fe1eb287-ef64-48e8-9c76-b068a26b3e2e-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:17:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e0472909-178d-4ca7-9195-ce685f266715 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "cinder-fe1eb287-ef64-48e8-9c76-b068a26b3e2e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:17:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e0472909-178d-4ca7-9195-ce685f266715 tempest-VolumesSnapshotListTestJSON-504997350 None] Acquiring lock "cinder-quobyte-fe1eb287-ef64-48e8-9c76-b068a26b3e2e" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:17:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e0472909-178d-4ca7-9195-ce685f266715 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "cinder-quobyte-fe1eb287-ef64-48e8-9c76-b068a26b3e2e" acquired by "delete_volume" :: waited 0.036s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:17:35 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54363f4-c746-45d3-a703-a8e281b340bf]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:17:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e0472909-178d-4ca7-9195-ce685f266715 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:36 devstack sudo[97834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e
Sep 16 16:17:36 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:36 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e0472909-178d-4ca7-9195-ce685f266715 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e" returned: 0 in 0.735s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e0472909-178d-4ca7-9195-ce685f266715 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:36 devstack sudo[97839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e
Sep 16 16:17:36 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:37 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e0472909-178d-4ca7-9195-ce685f266715 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fe1eb287-ef64-48e8-9c76-b068a26b3e2e" returned: 0 in 0.362s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e0472909-178d-4ca7-9195-ce685f266715 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "cinder-quobyte-fe1eb287-ef64-48e8-9c76-b068a26b3e2e" released by "delete_volume" :: held 1.256s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:17:37 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-e0472909-178d-4ca7-9195-ce685f266715 tempest-VolumesSnapshotListTestJSON-504997350 None] Created reservations ['4d705533-ca6f-417b-9d6d-21e0b575b1cd', '79f66e2d-b4bc-4f00-b1b7-bc7c08d541fb', '609470e7-3c96-4f4d-a94c-d4265ff4bba3', '83366231-e3eb-480a-b24e-3f20f699bf78'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:17:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e0472909-178d-4ca7-9195-ce685f266715 tempest-VolumesSnapshotListTestJSON-504997350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:17:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e0472909-178d-4ca7-9195-ce685f266715 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:17:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e0472909-178d-4ca7-9195-ce685f266715 tempest-VolumesSnapshotListTestJSON-504997350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:17:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e0472909-178d-4ca7-9195-ce685f266715 tempest-VolumesSnapshotListTestJSON-504997350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:17:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e0472909-178d-4ca7-9195-ce685f266715 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:17:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e0472909-178d-4ca7-9195-ce685f266715 tempest-VolumesSnapshotListTestJSON-504997350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:17:37 devstack sudo[97843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:17:37 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:17:37 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root
Sep 16 16:17:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e0472909-178d-4ca7-9195-ce685f266715 tempest-VolumesSnapshotListTestJSON-504997350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.344s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:17:37 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-e0472909-178d-4ca7-9195-ce685f266715 tempest-VolumesSnapshotListTestJSON-504997350 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:17:37 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-e0472909-178d-4ca7-9195-ce685f266715 tempest-VolumesSnapshotListTestJSON-504997350 None] Deleted volume successfully.
Sep 16 16:17:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e0472909-178d-4ca7-9195-ce685f266715 tempest-VolumesSnapshotListTestJSON-504997350 None] Lock "cinder-fe1eb287-ef64-48e8-9c76-b068a26b3e2e-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:17:47 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=51,cinder:UPDATE=54,cinder:DELETE=5,cinder:INSERT=16 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:17:47 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=51,cinder:UPDATE=58,cinder:INSERT=14,cinder:DELETE=3 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:17:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-1d4d5d91-5dfc-4727-ba29-2253386a6514 req-36556262-d54b-4410-9991-34386d0d7851 tempest-TestStampPattern-1514829522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:17:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-1d4d5d91-5dfc-4727-ba29-2253386a6514 req-36556262-d54b-4410-9991-34386d0d7851 tempest-TestStampPattern-1514829522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:17:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-1d4d5d91-5dfc-4727-ba29-2253386a6514 req-36556262-d54b-4410-9991-34386d0d7851 tempest-TestStampPattern-1514829522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:17:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-1d4d5d91-5dfc-4727-ba29-2253386a6514 req-36556262-d54b-4410-9991-34386d0d7851 tempest-TestStampPattern-1514829522 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-117a963f-d658-4f2b-8f8a-4947c505277c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b7e45ef-42b5-4ccf-90f0-fedf9e657f15', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:17:56 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-1d4d5d91-5dfc-4727-ba29-2253386a6514 req-36556262-d54b-4410-9991-34386d0d7851 tempest-TestStampPattern-1514829522 None] attachment_update completed successfully.
Sep 16 16:18:03 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-00aa97e4-3613-4dcf-88e7-5f2e83653bcb req-e2bca5c6-74dd-448e-b98d-40f2ee3e6160 tempest-TestStampPattern-1514829522 None] Terminate volume connection completed successfully.
Sep 16 16:18:03 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-00aa97e4-3613-4dcf-88e7-5f2e83653bcb req-e2bca5c6-74dd-448e-b98d-40f2ee3e6160 tempest-TestStampPattern-1514829522 None] Deleting attachment 1b7e45ef-42b5-4ccf-90f0-fedf9e657f15. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:18:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-95954608-9a8a-4bdc-8a0d-50b17bc6155f tempest-TestStampPattern-1514829522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-95954608-9a8a-4bdc-8a0d-50b17bc6155f tempest-TestStampPattern-1514829522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:04 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-95954608-9a8a-4bdc-8a0d-50b17bc6155f tempest-TestStampPattern-1514829522 None] Creating offline snapshot 8a6f1730-e9d7-4ffa-87e5-db577eb533f2 of volume 117a963f-d658-4f2b-8f8a-4947c505277c {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:18:04 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6036cb9a-89a8-4b5c-beb3-a3bcf7415726]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:18:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-95954608-9a8a-4bdc-8a0d-50b17bc6155f tempest-TestStampPattern-1514829522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:04 devstack sudo[98074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c
Sep 16 16:18:04 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:05 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-95954608-9a8a-4bdc-8a0d-50b17bc6155f tempest-TestStampPattern-1514829522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c" returned: 0 in 0.775s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-95954608-9a8a-4bdc-8a0d-50b17bc6155f tempest-TestStampPattern-1514829522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:05 devstack sudo[98083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2 1G
Sep 16 16:18:05 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:06 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-95954608-9a8a-4bdc-8a0d-50b17bc6155f tempest-TestStampPattern-1514829522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2 1G" returned: 0 in 0.914s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-95954608-9a8a-4bdc-8a0d-50b17bc6155f tempest-TestStampPattern-1514829522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117a963f-d658-4f2b-8f8a-4947c505277c -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:06 devstack sudo[98106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117a963f-d658-4f2b-8f8a-4947c505277c -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2
Sep 16 16:18:06 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:06 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-95954608-9a8a-4bdc-8a0d-50b17bc6155f tempest-TestStampPattern-1514829522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117a963f-d658-4f2b-8f8a-4947c505277c -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2" returned: 0 in 0.441s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:06 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-95954608-9a8a-4bdc-8a0d-50b17bc6155f tempest-TestStampPattern-1514829522 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2 is being set with open permissions: ugo+rw
Sep 16 16:18:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-95954608-9a8a-4bdc-8a0d-50b17bc6155f tempest-TestStampPattern-1514829522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:06 devstack sudo[98111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2
Sep 16 16:18:06 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:06 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-95954608-9a8a-4bdc-8a0d-50b17bc6155f tempest-TestStampPattern-1514829522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2" returned: 0 in 0.462s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-95954608-9a8a-4bdc-8a0d-50b17bc6155f tempest-TestStampPattern-1514829522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:07 devstack sudo[98115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.info
Sep 16 16:18:07 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:18:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:18:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:18:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:07 devstack sudo[98118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:18:07 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:07 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-95954608-9a8a-4bdc-8a0d-50b17bc6155f tempest-TestStampPattern-1514829522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.info" returned: 0 in 0.422s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:07 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-95954608-9a8a-4bdc-8a0d-50b17bc6155f tempest-TestStampPattern-1514829522 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.info is being set with open permissions: ugo+rw
Sep 16 16:18:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-95954608-9a8a-4bdc-8a0d-50b17bc6155f tempest-TestStampPattern-1514829522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:07 devstack sudo[98121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.info
Sep 16 16:18:07 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:07 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.520s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:18:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:18:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 29 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:18:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>, <Thread(tpool_thread_0, started daemon 135438770624192)>, <Thread(tpool_thread_1, started daemon 135438762231488)>, <Thread(tpool_thread_2, started daemon 135438753838784)>, <Thread(tpool_thread_3, started daemon 135438745446080)>, <Thread(tpool_thread_4, started daemon 135438737053376)>, <Thread(tpool_thread_5, started daemon 135438728660672)>, <Thread(tpool_thread_6, started daemon 135438720267968)>, <Thread(tpool_thread_7, started daemon 135438711875264)>, <Thread(tpool_thread_8, started daemon 135438703466176)>, <Thread(tpool_thread_9, started daemon 135438695057088)>, <Thread(tpool_thread_10, started daemon 135438686648000)>, <Thread(tpool_thread_11, started daemon 135438678238912)>, <Thread(tpool_thread_12, started daemon 135438669829824)>, <Thread(tpool_thread_13, started daemon 135438661420736)>, <Thread(tpool_thread_14, started daemon 135438653011648)>, <Thread(tpool_thread_15, started daemon 135438644602560)>, <Thread(tpool_thread_16, started daemon 135438636193472)>, <Thread(tpool_thread_17, started daemon 135438627784384)>, <Thread(tpool_thread_18, started daemon 135438619375296)>, <Thread(tpool_thread_19, started daemon 135438610966208)>, <Thread(Rabbit-heartbeat, started daemon 135438772197760)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:18:07 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-95954608-9a8a-4bdc-8a0d-50b17bc6155f tempest-TestStampPattern-1514829522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.info" returned: 0 in 0.517s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-95954608-9a8a-4bdc-8a0d-50b17bc6155f tempest-TestStampPattern-1514829522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.684s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:07 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-95954608-9a8a-4bdc-8a0d-50b17bc6155f tempest-TestStampPattern-1514829522 None] Create snapshot completed successfully
Sep 16 16:18:08 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-ffdc8c55-a9bc-4c79-9ebf-c5ee6a3d33eb req-25efcd1d-55eb-45ec-9c2f-f835d9ae504a tempest-TestShelveInstance-1732648310 None] Terminate volume connection completed successfully.
Sep 16 16:18:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-ffdc8c55-a9bc-4c79-9ebf-c5ee6a3d33eb req-25efcd1d-55eb-45ec-9c2f-f835d9ae504a tempest-TestShelveInstance-1732648310 None] Deleting attachment aeb6a393-caf8-4926-b8dd-2f079aeff17c. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:18:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-ffdc8c55-a9bc-4c79-9ebf-c5ee6a3d33eb req-c11d11bc-db2e-49bb-bf23-4b62f86c95de tempest-TestShelveInstance-1732648310 None] Acquiring lock "cinder-33d9277d-b7fb-4c3d-8f96-5416120e11b7-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:18:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-ffdc8c55-a9bc-4c79-9ebf-c5ee6a3d33eb req-c11d11bc-db2e-49bb-bf23-4b62f86c95de tempest-TestShelveInstance-1732648310 None] Lock "cinder-33d9277d-b7fb-4c3d-8f96-5416120e11b7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:18:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-ffdc8c55-a9bc-4c79-9ebf-c5ee6a3d33eb req-c11d11bc-db2e-49bb-bf23-4b62f86c95de tempest-TestShelveInstance-1732648310 None] Acquiring lock "cinder-quobyte-33d9277d-b7fb-4c3d-8f96-5416120e11b7" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:18:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-ffdc8c55-a9bc-4c79-9ebf-c5ee6a3d33eb req-c11d11bc-db2e-49bb-bf23-4b62f86c95de tempest-TestShelveInstance-1732648310 None] Lock "cinder-quobyte-33d9277d-b7fb-4c3d-8f96-5416120e11b7" acquired by "delete_volume" :: waited 0.049s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:18:09 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3862c5d0-be52-4eac-9a9d-a463a1a567b9]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:18:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-ffdc8c55-a9bc-4c79-9ebf-c5ee6a3d33eb req-c11d11bc-db2e-49bb-bf23-4b62f86c95de tempest-TestShelveInstance-1732648310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:09 devstack sudo[98127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7
Sep 16 16:18:09 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:10 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-ffdc8c55-a9bc-4c79-9ebf-c5ee6a3d33eb req-c11d11bc-db2e-49bb-bf23-4b62f86c95de tempest-TestShelveInstance-1732648310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7" returned: 0 in 0.806s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-ffdc8c55-a9bc-4c79-9ebf-c5ee6a3d33eb req-c11d11bc-db2e-49bb-bf23-4b62f86c95de tempest-TestShelveInstance-1732648310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:10 devstack sudo[98133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7
Sep 16 16:18:10 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:10 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-ffdc8c55-a9bc-4c79-9ebf-c5ee6a3d33eb req-c11d11bc-db2e-49bb-bf23-4b62f86c95de tempest-TestShelveInstance-1732648310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33d9277d-b7fb-4c3d-8f96-5416120e11b7" returned: 0 in 0.525s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:10 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-ffdc8c55-a9bc-4c79-9ebf-c5ee6a3d33eb req-c11d11bc-db2e-49bb-bf23-4b62f86c95de tempest-TestShelveInstance-1732648310 None] Lock "cinder-quobyte-33d9277d-b7fb-4c3d-8f96-5416120e11b7" released by "delete_volume" :: held 1.460s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:18:10 devstack cinder-volume[86165]: DEBUG cinder.quota [req-ffdc8c55-a9bc-4c79-9ebf-c5ee6a3d33eb req-c11d11bc-db2e-49bb-bf23-4b62f86c95de tempest-TestShelveInstance-1732648310 None] Created reservations ['0184bba9-6356-4c6d-bfb8-1cceda43872d', '9832abb5-9a44-4daf-9e88-ae5327155bb2', 'e0b03594-581e-4039-beb1-88fbf7dc5c14', 'f9f22fe6-5221-4ac0-81df-7dd16788b8bb'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:18:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-ffdc8c55-a9bc-4c79-9ebf-c5ee6a3d33eb req-c11d11bc-db2e-49bb-bf23-4b62f86c95de tempest-TestShelveInstance-1732648310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-ffdc8c55-a9bc-4c79-9ebf-c5ee6a3d33eb req-c11d11bc-db2e-49bb-bf23-4b62f86c95de tempest-TestShelveInstance-1732648310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [req-ffdc8c55-a9bc-4c79-9ebf-c5ee6a3d33eb req-c11d11bc-db2e-49bb-bf23-4b62f86c95de tempest-TestShelveInstance-1732648310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:18:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [req-ffdc8c55-a9bc-4c79-9ebf-c5ee6a3d33eb req-c11d11bc-db2e-49bb-bf23-4b62f86c95de tempest-TestShelveInstance-1732648310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:18:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-ffdc8c55-a9bc-4c79-9ebf-c5ee6a3d33eb req-c11d11bc-db2e-49bb-bf23-4b62f86c95de tempest-TestShelveInstance-1732648310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-ffdc8c55-a9bc-4c79-9ebf-c5ee6a3d33eb req-c11d11bc-db2e-49bb-bf23-4b62f86c95de tempest-TestShelveInstance-1732648310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:11 devstack sudo[98137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:18:11 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:11 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-ffdc8c55-a9bc-4c79-9ebf-c5ee6a3d33eb req-c11d11bc-db2e-49bb-bf23-4b62f86c95de tempest-TestShelveInstance-1732648310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.430s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:11 devstack cinder-volume[86165]: DEBUG cinder.manager [req-ffdc8c55-a9bc-4c79-9ebf-c5ee6a3d33eb req-c11d11bc-db2e-49bb-bf23-4b62f86c95de tempest-TestShelveInstance-1732648310 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:18:11 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-ffdc8c55-a9bc-4c79-9ebf-c5ee6a3d33eb req-c11d11bc-db2e-49bb-bf23-4b62f86c95de tempest-TestShelveInstance-1732648310 None] Deleted volume successfully.
Sep 16 16:18:11 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-ffdc8c55-a9bc-4c79-9ebf-c5ee6a3d33eb req-c11d11bc-db2e-49bb-bf23-4b62f86c95de tempest-TestShelveInstance-1732648310 None] Lock "cinder-33d9277d-b7fb-4c3d-8f96-5416120e11b7-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Flow 'volume_create_manager' (752d8f90-0640-4e76-b27b-c80eb79850ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a5f354-115c-47c2-af78-d38869b6e28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a5f354-115c-47c2-af78-d38869b6e28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1924645090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=257dc82e-c306-4b26-8637-3c547750c374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='602a321c3e75412c808c107c7a17823e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8a6f1730-e9d7-4ffa-87e5-db577eb533f2,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:18:18Z,use_quota=True,user_id='d1cb8e46ac4d4ee9ade2646dc37eb079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b653e12c-7042-4c7e-a17f-45b71e32a3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b653e12c-7042-4c7e-a17f-45b71e32a3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226b0d0f-7d2a-48ad-9d86-76924bbb19d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226b0d0f-7d2a-48ad-9d86-76924bbb19d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '257dc82e-c306-4b26-8637-3c547750c374', 'volume_name': 'volume-257dc82e-c306-4b26-8637-3c547750c374', 'volume_size': 1, 'snapshot_id': '8a6f1730-e9d7-4ffa-87e5-db577eb533f2'}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2473dc3b-d4be-41a5-a49c-a22e4d383209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2473dc3b-d4be-41a5-a49c-a22e4d383209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1556bd3b-20e7-41ce-ae0a-ffa26d76a1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:18 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Volume 257dc82e-c306-4b26-8637-3c547750c374: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-257dc82e-c306-4b26-8637-3c547750c374', 'volume_size': 1, 'snapshot_id': '8a6f1730-e9d7-4ffa-87e5-db577eb533f2'}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Acquiring lock "cinder-quobyte-8a6f1730-e9d7-4ffa-87e5-db577eb533f2-257dc82e-c306-4b26-8637-3c547750c374" by "_create_volume_from_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Lock "cinder-quobyte-8a6f1730-e9d7-4ffa-87e5-db577eb533f2-257dc82e-c306-4b26-8637-3c547750c374" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Creating volume 257dc82e-c306-4b26-8637-3c547750c374 from snapshot 8a6f1730-e9d7-4ffa-87e5-db577eb533f2 {{(pid=86165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Acquiring lock "cinder-quobyte-257dc82e-c306-4b26-8637-3c547750c374" by "_copy_volume_from_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Lock "cinder-quobyte-257dc82e-c306-4b26-8637-3c547750c374" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] snapshot: 8a6f1730-e9d7-4ffa-87e5-db577eb533f2, volume: 257dc82e-c306-4b26-8637-3c547750c374,  {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38be5fb-f080-4c5d-8571-bafdd99f89c7]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:18 devstack sudo[98205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2
Sep 16 16:18:18 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:18 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2" returned: 0 in 0.548s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-117a963f-d658-4f2b-8f8a-4947c505277c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef27241-3daf-4a99-bec7-91df8f0f2baa]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:18:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:19 devstack sudo[98210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c
Sep 16 16:18:19 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:19 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c" returned: 0 in 0.700s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] will copy from snapshot at /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 16:18:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Creating direct copy from snapshot {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 16:18:19 devstack cinder-volume[86165]: DEBUG cinder.utils [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Path /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-257dc82e-c306-4b26-8637-3c547750c374 not found in is_blk_device check {{(pid=86165) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 16:18:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-257dc82e-c306-4b26-8637-3c547750c374 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:19 devstack sudo[98222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-257dc82e-c306-4b26-8637-3c547750c374
Sep 16 16:18:19 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:28 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=18,cinder:UPDATE=13,cinder:INSERT=3 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:18:28 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=20,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:18:30 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-257dc82e-c306-4b26-8637-3c547750c374" returned: 0 in 11.169s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:30 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Image conversion details: src /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c, size 1024.00 MB, duration 11.17 sec, destination /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-257dc82e-c306-4b26-8637-3c547750c374 {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:18:30 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Converted 1024.00 MB image at 91.68 MB/s
Sep 16 16:18:30 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-257dc82e-c306-4b26-8637-3c547750c374 is being set with open permissions: ugo+rw
Sep 16 16:18:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-257dc82e-c306-4b26-8637-3c547750c374 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:30 devstack sudo[98316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-257dc82e-c306-4b26-8637-3c547750c374
Sep 16 16:18:30 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Flow 'volume_create_manager' (b7cfc1fb-2c30-4437-8061-71d0d8269286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d954c9-b3b3-47ce-95b4-d0562cf26536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:31 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-257dc82e-c306-4b26-8637-3c547750c374" returned: 0 in 0.579s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Lock "cinder-quobyte-257dc82e-c306-4b26-8637-3c547750c374" released by "_copy_volume_from_snapshot" :: held 13.179s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d954c9-b3b3-47ce-95b4-d0562cf26536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-487574994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1804a44-8b50-41d9-890a-f546bc30b9eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228052aae74d48618ef82bc2ad1c5439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:18:31Z,use_quota=True,user_id='5f8584f68ab64336866b6fb822a42f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d93c86-4a1f-4fe2-8340-9d0cc688a779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d93c86-4a1f-4fe2-8340-9d0cc688a779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e6894d4-1212-4522-bb1c-8e30d23d42b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e6894d4-1212-4522-bb1c-8e30d23d42b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1804a44-8b50-41d9-890a-f546bc30b9eb', 'volume_name': 'volume-b1804a44-8b50-41d9-890a-f546bc30b9eb', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80cfe80a-bc50-494e-9eda-d7a6510abd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80cfe80a-bc50-494e-9eda-d7a6510abd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12f505a-6e3b-4f00-ac1c-dd8110d4e338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:31 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Volume b1804a44-8b50-41d9-890a-f546bc30b9eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1804a44-8b50-41d9-890a-f546bc30b9eb', 'volume_size': 1}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Lock "cinder-quobyte-8a6f1730-e9d7-4ffa-87e5-db577eb533f2-257dc82e-c306-4b26-8637-3c547750c374" released by "_create_volume_from_snapshot" :: held 13.464s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.486s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.096s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-487574994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1804a44-8b50-41d9-890a-f546bc30b9eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228052aae74d48618ef82bc2ad1c5439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:18:31Z,use_quota=True,user_id='5f8584f68ab64336866b6fb822a42f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Creating volume b1804a44-8b50-41d9-890a-f546bc30b9eb {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:18:31 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b1804a44-8b50-41d9-890a-f546bc30b9eb 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1556bd3b-20e7-41ce-ae0a-ffa26d76a1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-257dc82e-c306-4b26-8637-3c547750c374', 'volume_size': 1, 'snapshot_id': '8a6f1730-e9d7-4ffa-87e5-db577eb533f2'}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:31 devstack sudo[98346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b1804a44-8b50-41d9-890a-f546bc30b9eb 1073741824
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e8c838-f738-4d6a-a60a-05a024a411d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:31 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:31 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Volume volume-257dc82e-c306-4b26-8637-3c547750c374 (257dc82e-c306-4b26-8637-3c547750c374): created successfully
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e8c838-f738-4d6a-a60a-05a024a411d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Flow 'volume_create_manager' (752d8f90-0640-4e76-b27b-c80eb79850ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:18:31 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b24505e8-7111-4fe4-be57-c3217151b0d6 tempest-TestStampPattern-1514829522 None] Created volume successfully.
Sep 16 16:18:32 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b1804a44-8b50-41d9-890a-f546bc30b9eb 1073741824" returned: 0 in 1.012s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b1804a44-8b50-41d9-890a-f546bc30b9eb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:32 devstack sudo[98356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b1804a44-8b50-41d9-890a-f546bc30b9eb
Sep 16 16:18:32 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:33 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b1804a44-8b50-41d9-890a-f546bc30b9eb" returned: 0 in 0.527s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:18:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12f505a-6e3b-4f00-ac1c-dd8110d4e338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1804a44-8b50-41d9-890a-f546bc30b9eb', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0edd809f-50bc-482d-9cd4-2a61430a660b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:33 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Volume volume-b1804a44-8b50-41d9-890a-f546bc30b9eb (b1804a44-8b50-41d9-890a-f546bc30b9eb): created successfully
Sep 16 16:18:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0edd809f-50bc-482d-9cd4-2a61430a660b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Flow 'volume_create_manager' (b7cfc1fb-2c30-4437-8061-71d0d8269286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:18:33 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-eba69aa5-da49-43f2-a9b9-c86daaba0ffd tempest-AttachVolumeNegativeTest-909556830 None] Created volume successfully.
Sep 16 16:18:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-7b16d483-3827-4b4b-9dae-9803ed2f7e96 req-132099ae-0f12-4db2-bab3-2205fffbfb17 tempest-AttachVolumeNegativeTest-909556830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-7b16d483-3827-4b4b-9dae-9803ed2f7e96 req-132099ae-0f12-4db2-bab3-2205fffbfb17 tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-7b16d483-3827-4b4b-9dae-9803ed2f7e96 req-132099ae-0f12-4db2-bab3-2205fffbfb17 tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-7b16d483-3827-4b4b-9dae-9803ed2f7e96 req-132099ae-0f12-4db2-bab3-2205fffbfb17 tempest-AttachVolumeNegativeTest-909556830 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-b1804a44-8b50-41d9-890a-f546bc30b9eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d01b7d5-11b2-4390-8158-62510f41b710', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:18:36 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-7b16d483-3827-4b4b-9dae-9803ed2f7e96 req-132099ae-0f12-4db2-bab3-2205fffbfb17 tempest-AttachVolumeNegativeTest-909556830 None] attachment_update completed successfully.
Sep 16 16:18:38 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:18:38 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Flow 'volume_create_manager' (69d99320-4332-4940-a100-a67c7abcd2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:18:38 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c51610a-8160-4797-ac18-30b5a07a75b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:39 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c51610a-8160-4797-ac18-30b5a07a75b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-820761741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8aafbfcd62430b9fc5a87d7874933e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:18:39Z,use_quota=True,user_id='a98c58a6930b46928381701b0d0e6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:39 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e211d2fd-3535-45f8-89b5-1bdd9d74ee3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:39 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e211d2fd-3535-45f8-89b5-1bdd9d74ee3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:39 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b929fab-dafb-40ad-8794-8941e2d2f568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:39 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b929fab-dafb-40ad-8794-8941e2d2f568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f', 'volume_name': 'volume-ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:39 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f16a8ffa-dda6-427e-b171-03027d06ec65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:39 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f16a8ffa-dda6-427e-b171-03027d06ec65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:39 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86cddfb2-d835-43ea-9088-e531cae127a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:39 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Volume ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f', 'volume_size': 1}
Sep 16 16:18:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-820761741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8aafbfcd62430b9fc5a87d7874933e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:18:39Z,use_quota=True,user_id='a98c58a6930b46928381701b0d0e6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:18:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Creating volume ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:18:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:18:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:18:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:18:39 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:18:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:39 devstack sudo[98829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f 1073741824
Sep 16 16:18:39 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:39 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f 1073741824" returned: 0 in 0.931s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:40 devstack sudo[98837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f
Sep 16 16:18:40 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:40 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f" returned: 0 in 0.390s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:18:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86cddfb2-d835-43ea-9088-e531cae127a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d467e7-d58c-48cc-912c-da64d36dbc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:40 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Volume volume-ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f (ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f): created successfully
Sep 16 16:18:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d467e7-d58c-48cc-912c-da64d36dbc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Flow 'volume_create_manager' (69d99320-4332-4940-a100-a67c7abcd2e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:18:40 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-3bd5ac77-8ab3-49ef-adcb-feeb44beaa71 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Created volume successfully.
Sep 16 16:18:42 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:18:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Flow 'volume_create_manager' (805903bd-98f1-41bd-9cc7-07dc294e580f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:18:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e08c24-3c1f-46d6-9717-905889a9a6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e08c24-3c1f-46d6-9717-905889a9a6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-314930516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8aafbfcd62430b9fc5a87d7874933e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:18:42Z,use_quota=True,user_id='a98c58a6930b46928381701b0d0e6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d05ca3b-fb6d-4164-bf0a-4d805e7ffd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d05ca3b-fb6d-4164-bf0a-4d805e7ffd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0506039-1ca7-40eb-90ac-318b9e945460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0506039-1ca7-40eb-90ac-318b9e945460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4', 'volume_name': 'volume-43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c68008-ec8e-4650-b3b3-da0c90456560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c68008-ec8e-4650-b3b3-da0c90456560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bdf8e4-7c64-4683-bd88-5063424988f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:42 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Volume 43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4', 'volume_size': 1}
Sep 16 16:18:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:42 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-314930516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8aafbfcd62430b9fc5a87d7874933e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:18:42Z,use_quota=True,user_id='a98c58a6930b46928381701b0d0e6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:18:42 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Creating volume 43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:18:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:42 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:18:42 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:18:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:42 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:18:42 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:18:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:42 devstack sudo[98841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4 1073741824
Sep 16 16:18:42 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:43 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:18:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Flow 'volume_create_manager' (eef1ac0f-021d-49ed-973f-6a11b13f86f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:18:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11c0b97-b8e9-48b8-96da-75103918904e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11c0b97-b8e9-48b8-96da-75103918904e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-784630953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8aafbfcd62430b9fc5a87d7874933e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:18:44Z,use_quota=True,user_id='a98c58a6930b46928381701b0d0e6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:43 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a733895-c574-4dda-a6c3-55e3052ed9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a733895-c574-4dda-a6c3-55e3052ed9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cee6c8-074a-44d9-96af-520710390773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cee6c8-074a-44d9-96af-520710390773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b', 'volume_name': 'volume-81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53060166-7054-4647-be29-4b4ff195f424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53060166-7054-4647-be29-4b4ff195f424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3375ec66-88f0-4df6-9bbe-d7674829325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:43 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Volume 81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b', 'volume_size': 1}
Sep 16 16:18:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4 1073741824" returned: 0 in 1.091s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:44 devstack sudo[98848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4
Sep 16 16:18:44 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:44 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:18:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Flow 'volume_create_manager' (d339d63d-5cbf-41b7-a567-2c8981ede14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:18:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98b60c3-1e1b-443a-bd4d-306b032f11d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98b60c3-1e1b-443a-bd4d-306b032f11d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1538061062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3bd9f9-d523-4f58-8105-a6c0a70577c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8aafbfcd62430b9fc5a87d7874933e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:18:45Z,use_quota=True,user_id='a98c58a6930b46928381701b0d0e6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:45 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc49d52-5e28-4361-bd32-c44ae7287394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc49d52-5e28-4361-bd32-c44ae7287394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf37f10d-b15b-4565-a99a-a964ed0a1779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf37f10d-b15b-4565-a99a-a964ed0a1779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3bd9f9-d523-4f58-8105-a6c0a70577c4', 'volume_name': 'volume-6b3bd9f9-d523-4f58-8105-a6c0a70577c4', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dfa84db-8c6b-4946-8670-4c59b22a4352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dfa84db-8c6b-4946-8670-4c59b22a4352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b65692-aee0-4165-95d8-e6e182390eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:45 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Volume 6b3bd9f9-d523-4f58-8105-a6c0a70577c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3bd9f9-d523-4f58-8105-a6c0a70577c4', 'volume_size': 1}
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4" returned: 0 in 1.139s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] <== create_volume: return (2355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.360s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.256s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-784630953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8aafbfcd62430b9fc5a87d7874933e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:18:44Z,use_quota=True,user_id='a98c58a6930b46928381701b0d0e6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Creating volume 81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:18:45 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:45 devstack sudo[98852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b 1073741824
Sep 16 16:18:45 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bdf8e4-7c64-4683-bd88-5063424988f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9453c160-86d8-467e-8afe-347a663cda14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:45 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Volume volume-43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4 (43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4): created successfully
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9453c160-86d8-467e-8afe-347a663cda14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Flow 'volume_create_manager' (805903bd-98f1-41bd-9cc7-07dc294e580f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:18:45 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-652b1283-b9ed-4ff6-a8ac-b64a44bb7af4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Created volume successfully.
Sep 16 16:18:46 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:18:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Flow 'volume_create_manager' (65f18e9a-ba7a-438b-8674-0613e3612903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:18:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa364878-2ff2-40ec-83d0-16096cbd81d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa364878-2ff2-40ec-83d0-16096cbd81d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-230112603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c866b752-d1be-465c-8a1d-173236096638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8aafbfcd62430b9fc5a87d7874933e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:18:46Z,use_quota=True,user_id='a98c58a6930b46928381701b0d0e6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8f3be7-3ec2-404f-9fda-6a68eea57c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8f3be7-3ec2-404f-9fda-6a68eea57c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b16c99-e575-43e4-8402-3b38679bd468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b16c99-e575-43e4-8402-3b38679bd468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c866b752-d1be-465c-8a1d-173236096638', 'volume_name': 'volume-c866b752-d1be-465c-8a1d-173236096638', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe209ef2-d6ca-4643-a14a-de2728b96ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe209ef2-d6ca-4643-a14a-de2728b96ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c8f008-53a2-42fb-a34f-e091677fe1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:46 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Volume c866b752-d1be-465c-8a1d-173236096638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c866b752-d1be-465c-8a1d-173236096638', 'volume_size': 1}
Sep 16 16:18:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:47 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b 1073741824" returned: 0 in 1.976s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:47 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:18:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Flow 'volume_create_manager' (6b5612fb-4066-45fd-bf92-5ebf63d8378c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:18:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3140adc4-de90-42d3-9395-e8eee40903ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3140adc4-de90-42d3-9395-e8eee40903ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2026525989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b971691-77eb-4cae-ba6e-991c8910d21b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8aafbfcd62430b9fc5a87d7874933e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:18:47Z,use_quota=True,user_id='a98c58a6930b46928381701b0d0e6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c00938a-663e-48d8-b642-5080fb19ca66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c00938a-663e-48d8-b642-5080fb19ca66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec6286d-11e9-442c-a0d5-5805992ceb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec6286d-11e9-442c-a0d5-5805992ceb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b971691-77eb-4cae-ba6e-991c8910d21b', 'volume_name': 'volume-9b971691-77eb-4cae-ba6e-991c8910d21b', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234dcbb1-466e-4855-9973-0c415626c9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234dcbb1-466e-4855-9973-0c415626c9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7500bd1-c8fe-48a0-b704-3fb9a7afc337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:47 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Volume 9b971691-77eb-4cae-ba6e-991c8910d21b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b971691-77eb-4cae-ba6e-991c8910d21b', 'volume_size': 1}
Sep 16 16:18:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:47 devstack sudo[98883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b
Sep 16 16:18:47 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:48 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b" returned: 0 in 0.479s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] <== create_volume: return (2942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:18:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.948s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.990s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1538061062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3bd9f9-d523-4f58-8105-a6c0a70577c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8aafbfcd62430b9fc5a87d7874933e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:18:45Z,use_quota=True,user_id='a98c58a6930b46928381701b0d0e6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:18:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Creating volume 6b3bd9f9-d523-4f58-8105-a6c0a70577c4 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:18:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:18:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:18:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:18:48 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:18:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6b3bd9f9-d523-4f58-8105-a6c0a70577c4 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:48 devstack sudo[98895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6b3bd9f9-d523-4f58-8105-a6c0a70577c4 1073741824
Sep 16 16:18:48 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3375ec66-88f0-4df6-9bbe-d7674829325f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79aaf9d6-eefe-4161-8e67-32453c1fdd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:48 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Volume volume-81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b (81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b): created successfully
Sep 16 16:18:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79aaf9d6-eefe-4161-8e67-32453c1fdd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Flow 'volume_create_manager' (eef1ac0f-021d-49ed-973f-6a11b13f86f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:18:48 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-0848631a-882d-4e0c-a856-be18a05fb755 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Created volume successfully.
Sep 16 16:18:48 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6b3bd9f9-d523-4f58-8105-a6c0a70577c4 1073741824" returned: 0 in 0.743s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6b3bd9f9-d523-4f58-8105-a6c0a70577c4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:49 devstack sudo[98912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6b3bd9f9-d523-4f58-8105-a6c0a70577c4
Sep 16 16:18:49 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:49 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6b3bd9f9-d523-4f58-8105-a6c0a70577c4" returned: 0 in 0.558s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:18:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.881s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-230112603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c866b752-d1be-465c-8a1d-173236096638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8aafbfcd62430b9fc5a87d7874933e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:18:46Z,use_quota=True,user_id='a98c58a6930b46928381701b0d0e6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:18:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Creating volume c866b752-d1be-465c-8a1d-173236096638 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:18:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:18:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:18:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:18:49 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:18:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c866b752-d1be-465c-8a1d-173236096638 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b65692-aee0-4165-95d8-e6e182390eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3bd9f9-d523-4f58-8105-a6c0a70577c4', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:49 devstack sudo[98927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c866b752-d1be-465c-8a1d-173236096638 1073741824
Sep 16 16:18:49 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f1ca52-cf01-4ce8-97ea-541b581c13b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:49 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Volume volume-6b3bd9f9-d523-4f58-8105-a6c0a70577c4 (6b3bd9f9-d523-4f58-8105-a6c0a70577c4): created successfully
Sep 16 16:18:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f1ca52-cf01-4ce8-97ea-541b581c13b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Flow 'volume_create_manager' (d339d63d-5cbf-41b7-a567-2c8981ede14e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:18:49 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-ff137a84-3f8d-405c-a269-6d866c2d96ba tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Created volume successfully.
Sep 16 16:18:50 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c866b752-d1be-465c-8a1d-173236096638 1073741824" returned: 0 in 0.793s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c866b752-d1be-465c-8a1d-173236096638 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:50 devstack sudo[98937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c866b752-d1be-465c-8a1d-173236096638
Sep 16 16:18:50 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:50 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c866b752-d1be-465c-8a1d-173236096638" returned: 0 in 0.469s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:50 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:18:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.331s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:50 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2026525989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b971691-77eb-4cae-ba6e-991c8910d21b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8aafbfcd62430b9fc5a87d7874933e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:18:47Z,use_quota=True,user_id='a98c58a6930b46928381701b0d0e6fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:18:50 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Creating volume 9b971691-77eb-4cae-ba6e-991c8910d21b {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:18:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:50 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:18:50 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:18:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:50 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:18:50 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:18:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b971691-77eb-4cae-ba6e-991c8910d21b 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c8f008-53a2-42fb-a34f-e091677fe1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c866b752-d1be-465c-8a1d-173236096638', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0095eea4-5bdd-4a7d-9e56-580946723cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:51 devstack sudo[98941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b971691-77eb-4cae-ba6e-991c8910d21b 1073741824
Sep 16 16:18:51 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:51 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Volume volume-c866b752-d1be-465c-8a1d-173236096638 (c866b752-d1be-465c-8a1d-173236096638): created successfully
Sep 16 16:18:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0095eea4-5bdd-4a7d-9e56-580946723cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Flow 'volume_create_manager' (65f18e9a-ba7a-438b-8674-0613e3612903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:18:51 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-8ec80b9a-9714-46f8-8cb7-84f520c237e4 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Created volume successfully.
Sep 16 16:18:51 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b971691-77eb-4cae-ba6e-991c8910d21b 1073741824" returned: 0 in 0.830s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b971691-77eb-4cae-ba6e-991c8910d21b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:51 devstack sudo[98963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b971691-77eb-4cae-ba6e-991c8910d21b
Sep 16 16:18:51 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:52 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b971691-77eb-4cae-ba6e-991c8910d21b" returned: 0 in 0.279s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:18:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7500bd1-c8fe-48a0-b704-3fb9a7afc337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b971691-77eb-4cae-ba6e-991c8910d21b', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99da0f2c-663e-418c-8fb2-b0f795a8c12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:18:52 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Volume volume-9b971691-77eb-4cae-ba6e-991c8910d21b (9b971691-77eb-4cae-ba6e-991c8910d21b): created successfully
Sep 16 16:18:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99da0f2c-663e-418c-8fb2-b0f795a8c12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:18:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Flow 'volume_create_manager' (6b5612fb-4066-45fd-bf92-5ebf63d8378c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:18:52 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-94de4140-c936-4d6f-9e6d-fae5091979b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Created volume successfully.
Sep 16 16:18:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-71bbcf19-412a-41cc-a20a-ecdfc7cf03b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "cinder-9b971691-77eb-4cae-ba6e-991c8910d21b-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:18:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-71bbcf19-412a-41cc-a20a-ecdfc7cf03b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-9b971691-77eb-4cae-ba6e-991c8910d21b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:18:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-71bbcf19-412a-41cc-a20a-ecdfc7cf03b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "cinder-quobyte-9b971691-77eb-4cae-ba6e-991c8910d21b" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:18:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-71bbcf19-412a-41cc-a20a-ecdfc7cf03b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-quobyte-9b971691-77eb-4cae-ba6e-991c8910d21b" acquired by "delete_volume" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:18:53 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2379e53-f232-41c3-a2ee-4a032473ac72]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:18:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-71bbcf19-412a-41cc-a20a-ecdfc7cf03b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b971691-77eb-4cae-ba6e-991c8910d21b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:53 devstack sudo[98971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b971691-77eb-4cae-ba6e-991c8910d21b
Sep 16 16:18:53 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:53 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-71bbcf19-412a-41cc-a20a-ecdfc7cf03b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b971691-77eb-4cae-ba6e-991c8910d21b" returned: 0 in 0.489s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-71bbcf19-412a-41cc-a20a-ecdfc7cf03b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b971691-77eb-4cae-ba6e-991c8910d21b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:53 devstack sudo[98977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b971691-77eb-4cae-ba6e-991c8910d21b
Sep 16 16:18:53 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:54 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-71bbcf19-412a-41cc-a20a-ecdfc7cf03b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9b971691-77eb-4cae-ba6e-991c8910d21b" returned: 0 in 0.311s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-71bbcf19-412a-41cc-a20a-ecdfc7cf03b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-quobyte-9b971691-77eb-4cae-ba6e-991c8910d21b" released by "delete_volume" :: held 0.873s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:18:54 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-71bbcf19-412a-41cc-a20a-ecdfc7cf03b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Created reservations ['6b1de3dc-fd14-41a5-b9aa-8f683327d4a0', 'e061a310-b58c-495a-ba8b-2995ab1c9f1d', '9a28b7f9-d81c-4331-af68-bcb65c10c22a', 'ba66a05d-0095-4a41-b30a-798127f06bf1'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:18:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-71bbcf19-412a-41cc-a20a-ecdfc7cf03b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-71bbcf19-412a-41cc-a20a-ecdfc7cf03b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-71bbcf19-412a-41cc-a20a-ecdfc7cf03b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:18:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-71bbcf19-412a-41cc-a20a-ecdfc7cf03b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:18:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-71bbcf19-412a-41cc-a20a-ecdfc7cf03b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-71bbcf19-412a-41cc-a20a-ecdfc7cf03b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:54 devstack sudo[98995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:18:54 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:55 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-71bbcf19-412a-41cc-a20a-ecdfc7cf03b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.588s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:55 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-71bbcf19-412a-41cc-a20a-ecdfc7cf03b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:18:55 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-71bbcf19-412a-41cc-a20a-ecdfc7cf03b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Deleted volume successfully.
Sep 16 16:18:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-71bbcf19-412a-41cc-a20a-ecdfc7cf03b1 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-9b971691-77eb-4cae-ba6e-991c8910d21b-delete_volume" released by "delete_volume" :: held 1.946s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:18:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d00b7deb-d93d-4adc-9947-5329c1727b8c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "cinder-c866b752-d1be-465c-8a1d-173236096638-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:18:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d00b7deb-d93d-4adc-9947-5329c1727b8c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-c866b752-d1be-465c-8a1d-173236096638-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:18:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d00b7deb-d93d-4adc-9947-5329c1727b8c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "cinder-quobyte-c866b752-d1be-465c-8a1d-173236096638" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:18:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d00b7deb-d93d-4adc-9947-5329c1727b8c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-quobyte-c866b752-d1be-465c-8a1d-173236096638" acquired by "delete_volume" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:18:55 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee1b928-ec0e-490d-8bc8-be174407f593]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:18:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d00b7deb-d93d-4adc-9947-5329c1727b8c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c866b752-d1be-465c-8a1d-173236096638 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:55 devstack sudo[99023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c866b752-d1be-465c-8a1d-173236096638
Sep 16 16:18:55 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:56 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d00b7deb-d93d-4adc-9947-5329c1727b8c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c866b752-d1be-465c-8a1d-173236096638" returned: 0 in 0.429s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d00b7deb-d93d-4adc-9947-5329c1727b8c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c866b752-d1be-465c-8a1d-173236096638 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:56 devstack sudo[99030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c866b752-d1be-465c-8a1d-173236096638
Sep 16 16:18:56 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:56 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d00b7deb-d93d-4adc-9947-5329c1727b8c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c866b752-d1be-465c-8a1d-173236096638" returned: 0 in 0.332s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:56 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d00b7deb-d93d-4adc-9947-5329c1727b8c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-quobyte-c866b752-d1be-465c-8a1d-173236096638" released by "delete_volume" :: held 0.810s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:18:56 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-d00b7deb-d93d-4adc-9947-5329c1727b8c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Created reservations ['12ffc7c5-2e45-4553-a0fb-6c6c930876d7', '46bbce38-2dbd-43e0-8447-7750b67f38b3', 'ff4592c3-f123-43d7-b09c-c34dd2044898', '19c44499-6b14-4717-9262-6b2e4ce83298'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:18:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d00b7deb-d93d-4adc-9947-5329c1727b8c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d00b7deb-d93d-4adc-9947-5329c1727b8c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d00b7deb-d93d-4adc-9947-5329c1727b8c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:18:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d00b7deb-d93d-4adc-9947-5329c1727b8c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:18:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d00b7deb-d93d-4adc-9947-5329c1727b8c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d00b7deb-d93d-4adc-9947-5329c1727b8c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:56 devstack sudo[99033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:18:56 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:56 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-841ed88e-c93a-4120-94d1-570a3f45e58f tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "cinder-6b3bd9f9-d523-4f58-8105-a6c0a70577c4-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:18:56 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-841ed88e-c93a-4120-94d1-570a3f45e58f tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-6b3bd9f9-d523-4f58-8105-a6c0a70577c4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:18:56 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-841ed88e-c93a-4120-94d1-570a3f45e58f tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "cinder-quobyte-6b3bd9f9-d523-4f58-8105-a6c0a70577c4" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:18:56 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-841ed88e-c93a-4120-94d1-570a3f45e58f tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-quobyte-6b3bd9f9-d523-4f58-8105-a6c0a70577c4" acquired by "delete_volume" :: waited 0.023s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:18:56 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d00b7deb-d93d-4adc-9947-5329c1727b8c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.381s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:56 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-d00b7deb-d93d-4adc-9947-5329c1727b8c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:18:56 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-d00b7deb-d93d-4adc-9947-5329c1727b8c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Deleted volume successfully.
Sep 16 16:18:56 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9204f221-b624-41ca-bcac-8b891caf5bdb]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:18:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-841ed88e-c93a-4120-94d1-570a3f45e58f tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6b3bd9f9-d523-4f58-8105-a6c0a70577c4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d00b7deb-d93d-4adc-9947-5329c1727b8c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-c866b752-d1be-465c-8a1d-173236096638-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:18:57 devstack sudo[99060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6b3bd9f9-d523-4f58-8105-a6c0a70577c4
Sep 16 16:18:57 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:57 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-841ed88e-c93a-4120-94d1-570a3f45e58f tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6b3bd9f9-d523-4f58-8105-a6c0a70577c4" returned: 0 in 0.503s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-841ed88e-c93a-4120-94d1-570a3f45e58f tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6b3bd9f9-d523-4f58-8105-a6c0a70577c4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:57 devstack sudo[99065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6b3bd9f9-d523-4f58-8105-a6c0a70577c4
Sep 16 16:18:57 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:57 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-841ed88e-c93a-4120-94d1-570a3f45e58f tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6b3bd9f9-d523-4f58-8105-a6c0a70577c4" returned: 0 in 0.339s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-841ed88e-c93a-4120-94d1-570a3f45e58f tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-quobyte-6b3bd9f9-d523-4f58-8105-a6c0a70577c4" released by "delete_volume" :: held 0.919s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:18:57 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-841ed88e-c93a-4120-94d1-570a3f45e58f tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Created reservations ['b7720015-5d98-4369-a12b-0ddfb936d9b8', '6d91e4d5-1f45-40bb-b7af-718121bbfed1', '2d68d8e5-de56-4e7b-8727-ec3349e8d136', 'c5606355-f0b4-4fb1-9b40-c51a17179590'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:18:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-841ed88e-c93a-4120-94d1-570a3f45e58f tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:18:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-841ed88e-c93a-4120-94d1-570a3f45e58f tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:18:58 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-841ed88e-c93a-4120-94d1-570a3f45e58f tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:18:58 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-841ed88e-c93a-4120-94d1-570a3f45e58f tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:18:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-841ed88e-c93a-4120-94d1-570a3f45e58f tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:18:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-841ed88e-c93a-4120-94d1-570a3f45e58f tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:58 devstack sudo[99069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:18:58 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:58 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-841ed88e-c93a-4120-94d1-570a3f45e58f tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.309s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:58 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-841ed88e-c93a-4120-94d1-570a3f45e58f tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:18:58 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-841ed88e-c93a-4120-94d1-570a3f45e58f tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Deleted volume successfully.
Sep 16 16:18:58 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-841ed88e-c93a-4120-94d1-570a3f45e58f tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-6b3bd9f9-d523-4f58-8105-a6c0a70577c4-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:18:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3eb55c80-50b4-4a27-8a5f-090ba219badc tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "cinder-81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:18:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3eb55c80-50b4-4a27-8a5f-090ba219badc tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:18:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3eb55c80-50b4-4a27-8a5f-090ba219badc tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "cinder-quobyte-81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:18:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3eb55c80-50b4-4a27-8a5f-090ba219badc tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-quobyte-81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b" acquired by "delete_volume" :: waited 0.022s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:18:59 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9046440d-f4e8-451d-a205-5090d3ac03c6]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:18:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3eb55c80-50b4-4a27-8a5f-090ba219badc tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:59 devstack sudo[99075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b
Sep 16 16:18:59 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:59 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root
Sep 16 16:18:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3eb55c80-50b4-4a27-8a5f-090ba219badc tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b" returned: 0 in 0.510s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:18:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3eb55c80-50b4-4a27-8a5f-090ba219badc tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:18:59 devstack sudo[99080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b
Sep 16 16:18:59 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:18:59 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:18:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Flow 'volume_create_manager' (251f92d0-4186-4f89-bd09-f5fda6712b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad119940-a4ae-4bfa-aaa3-fa41911db151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad119940-a4ae-4bfa-aaa3-fa41911db151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-753456424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff45b16-4271-4eb4-a775-08f15d629ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f457ec71e7946a19254443840d6b08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:19:00Z,use_quota=True,user_id='d31b30cb63634c1e9944162b6af5a679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c70727-fe2e-479f-aaca-93695f6bda2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c70727-fe2e-479f-aaca-93695f6bda2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93cc402e-0a3e-4d04-86ed-4c83b2d791e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93cc402e-0a3e-4d04-86ed-4c83b2d791e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bff45b16-4271-4eb4-a775-08f15d629ab1', 'volume_name': 'volume-bff45b16-4271-4eb4-a775-08f15d629ab1', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1195039-3fd6-4379-a640-ef6a12873046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1195039-3fd6-4379-a640-ef6a12873046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b3a51b-099f-4219-bb3f-0a38a775d365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:19:00 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Volume bff45b16-4271-4eb4-a775-08f15d629ab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bff45b16-4271-4eb4-a775-08f15d629ab1', 'volume_size': 1}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-753456424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff45b16-4271-4eb4-a775-08f15d629ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f457ec71e7946a19254443840d6b08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:19:00Z,use_quota=True,user_id='d31b30cb63634c1e9944162b6af5a679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Creating volume bff45b16-4271-4eb4-a775-08f15d629ab1 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:19:00 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bff45b16-4271-4eb4-a775-08f15d629ab1 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:00 devstack sudo[99116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bff45b16-4271-4eb4-a775-08f15d629ab1 1073741824
Sep 16 16:19:00 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:00 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3eb55c80-50b4-4a27-8a5f-090ba219badc tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b" returned: 0 in 0.391s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3eb55c80-50b4-4a27-8a5f-090ba219badc tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-quobyte-81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b" released by "delete_volume" :: held 0.980s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-3eb55c80-50b4-4a27-8a5f-090ba219badc tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Created reservations ['cb80598c-7d3f-4f11-b0cf-e774350dc39d', '6b93202a-fa0e-40fb-b388-54dbd43283af', '3e860e73-719f-469d-a87b-cc8ed72495c4', 'd014da53-c6da-4758-a637-7582656d17c4'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3eb55c80-50b4-4a27-8a5f-090ba219badc tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3eb55c80-50b4-4a27-8a5f-090ba219badc tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3eb55c80-50b4-4a27-8a5f-090ba219badc tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3eb55c80-50b4-4a27-8a5f-090ba219badc tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3eb55c80-50b4-4a27-8a5f-090ba219badc tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3eb55c80-50b4-4a27-8a5f-090ba219badc tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:00 devstack sudo[99121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:19:00 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:00 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:00 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bff45b16-4271-4eb4-a775-08f15d629ab1 1073741824" returned: 0 in 0.631s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3eb55c80-50b4-4a27-8a5f-090ba219badc tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.351s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-3eb55c80-50b4-4a27-8a5f-090ba219badc tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:19:00 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-3eb55c80-50b4-4a27-8a5f-090ba219badc tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Deleted volume successfully.
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3eb55c80-50b4-4a27-8a5f-090ba219badc tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-81fb9b45-7ca8-4c8d-a986-ba9bdc811d5b-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bff45b16-4271-4eb4-a775-08f15d629ab1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:00 devstack sudo[99128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bff45b16-4271-4eb4-a775-08f15d629ab1
Sep 16 16:19:00 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:01 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bff45b16-4271-4eb4-a775-08f15d629ab1" returned: 0 in 0.272s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:01 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:19:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:19:01 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b3a51b-099f-4219-bb3f-0a38a775d365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bff45b16-4271-4eb4-a775-08f15d629ab1', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:19:01 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed0a1cb-d6fa-4b2a-abfe-a530bf2fbb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:19:01 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Volume volume-bff45b16-4271-4eb4-a775-08f15d629ab1 (bff45b16-4271-4eb4-a775-08f15d629ab1): created successfully
Sep 16 16:19:01 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed0a1cb-d6fa-4b2a-abfe-a530bf2fbb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:19:01 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Flow 'volume_create_manager' (251f92d0-4186-4f89-bd09-f5fda6712b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:19:01 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-8404e625-3537-4ee2-9b81-6c637e4878b0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Created volume successfully.
Sep 16 16:19:01 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-33ed2781-8efc-464f-aada-938f12c66d88 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "cinder-43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:19:01 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-33ed2781-8efc-464f-aada-938f12c66d88 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:19:01 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-33ed2781-8efc-464f-aada-938f12c66d88 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "cinder-quobyte-43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:19:01 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-33ed2781-8efc-464f-aada-938f12c66d88 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-quobyte-43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4" acquired by "delete_volume" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:19:01 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60c502e-a9d6-46fb-8a49-b18a136bd658]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:19:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-33ed2781-8efc-464f-aada-938f12c66d88 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:01 devstack sudo[99131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4
Sep 16 16:19:01 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:01 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-33ed2781-8efc-464f-aada-938f12c66d88 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4" returned: 0 in 0.363s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-33ed2781-8efc-464f-aada-938f12c66d88 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:01 devstack sudo[99136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4
Sep 16 16:19:01 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:02 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-33ed2781-8efc-464f-aada-938f12c66d88 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4" returned: 0 in 0.261s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-33ed2781-8efc-464f-aada-938f12c66d88 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-quobyte-43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4" released by "delete_volume" :: held 0.672s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:02 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-33ed2781-8efc-464f-aada-938f12c66d88 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Created reservations ['75f784f9-3154-4aba-aee3-dbcb59ee9c84', '003f9eaa-99ef-4ed1-92f8-3a360854af9e', '89fe05f6-bdc1-4b95-8a11-c734e69f6086', '4ef002e2-a1e0-4f3f-ba8b-5b2e374802ed'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:19:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-33ed2781-8efc-464f-aada-938f12c66d88 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:19:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-33ed2781-8efc-464f-aada-938f12c66d88 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:19:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-33ed2781-8efc-464f-aada-938f12c66d88 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:19:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-33ed2781-8efc-464f-aada-938f12c66d88 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:19:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-33ed2781-8efc-464f-aada-938f12c66d88 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:19:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-33ed2781-8efc-464f-aada-938f12c66d88 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:02 devstack sudo[99142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:19:02 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b9e4260d-892d-40e5-a619-bec3ca469e4c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "cinder-ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:19:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b9e4260d-892d-40e5-a619-bec3ca469e4c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:19:02 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-33ed2781-8efc-464f-aada-938f12c66d88 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.409s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:02 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-33ed2781-8efc-464f-aada-938f12c66d88 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:19:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b9e4260d-892d-40e5-a619-bec3ca469e4c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "cinder-quobyte-ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:19:02 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-33ed2781-8efc-464f-aada-938f12c66d88 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Deleted volume successfully.
Sep 16 16:19:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b9e4260d-892d-40e5-a619-bec3ca469e4c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-quobyte-ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f" acquired by "delete_volume" :: waited 0.045s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:19:02 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f580e6c-9423-4c78-a677-25a869978d6e]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:19:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b9e4260d-892d-40e5-a619-bec3ca469e4c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-33ed2781-8efc-464f-aada-938f12c66d88 tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-43a7fcfc-2abe-48f2-a4a9-256fa1fcd8f4-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:03 devstack sudo[99149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f
Sep 16 16:19:03 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-10e81091-dcf4-46bf-8903-94fd6217beb0 req-77c21892-a0ac-4785-940f-198d9778d01a tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:19:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-10e81091-dcf4-46bf-8903-94fd6217beb0 req-77c21892-a0ac-4785-940f-198d9778d01a tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:19:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-10e81091-dcf4-46bf-8903-94fd6217beb0 req-77c21892-a0ac-4785-940f-198d9778d01a tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:19:03 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-10e81091-dcf4-46bf-8903-94fd6217beb0 req-77c21892-a0ac-4785-940f-198d9778d01a tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-bff45b16-4271-4eb4-a775-08f15d629ab1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb4577c2-6d8d-4b66-98fc-fbb0a9a30460', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:19:03 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-10e81091-dcf4-46bf-8903-94fd6217beb0 req-77c21892-a0ac-4785-940f-198d9778d01a tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] attachment_update completed successfully.
Sep 16 16:19:03 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b9e4260d-892d-40e5-a619-bec3ca469e4c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f" returned: 0 in 0.549s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b9e4260d-892d-40e5-a619-bec3ca469e4c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:03 devstack sudo[99159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f
Sep 16 16:19:03 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:03 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b9e4260d-892d-40e5-a619-bec3ca469e4c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f" returned: 0 in 0.346s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:03 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b9e4260d-892d-40e5-a619-bec3ca469e4c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-quobyte-ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f" released by "delete_volume" :: held 0.977s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:03 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-b9e4260d-892d-40e5-a619-bec3ca469e4c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Created reservations ['d174efb3-d54c-43f2-b588-bd502e6c82b6', 'a756d3fa-4df7-4301-9d87-3cbb8b8597d7', '6593702a-93bb-4197-a74e-63bc411a2670', '760e5666-1bca-46d6-8fda-c02fb066fe2c'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:19:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b9e4260d-892d-40e5-a619-bec3ca469e4c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:19:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b9e4260d-892d-40e5-a619-bec3ca469e4c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:19:04 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b9e4260d-892d-40e5-a619-bec3ca469e4c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:19:04 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b9e4260d-892d-40e5-a619-bec3ca469e4c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:19:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b9e4260d-892d-40e5-a619-bec3ca469e4c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:19:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b9e4260d-892d-40e5-a619-bec3ca469e4c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:04 devstack sudo[99164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:19:04 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:04 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b9e4260d-892d-40e5-a619-bec3ca469e4c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.269s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:04 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-b9e4260d-892d-40e5-a619-bec3ca469e4c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:19:04 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b9e4260d-892d-40e5-a619-bec3ca469e4c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Deleted volume successfully.
Sep 16 16:19:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b9e4260d-892d-40e5-a619-bec3ca469e4c tempest-CreateVolumesFromSourceVolumeTest-212067953 None] Lock "cinder-ee4e7b6e-d6f5-48ed-9730-64b7aaa92d5f-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:07 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-7b76f87f-0030-49d3-b300-ffacdcf26f02 req-8bbb12b9-b61b-4923-a656-bbe0ced61111 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Terminate volume connection completed successfully.
Sep 16 16:19:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-7b76f87f-0030-49d3-b300-ffacdcf26f02 req-8bbb12b9-b61b-4923-a656-bbe0ced61111 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Deleting attachment bb4577c2-6d8d-4b66-98fc-fbb0a9a30460. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:19:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:19:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:19:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:19:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:19:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:19:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:19:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:07 devstack sudo[99175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:19:07 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:07 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.418s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:19:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:19:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 29 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:19:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>, <Thread(tpool_thread_0, started daemon 135438770624192)>, <Thread(tpool_thread_1, started daemon 135438762231488)>, <Thread(tpool_thread_2, started daemon 135438753838784)>, <Thread(tpool_thread_3, started daemon 135438745446080)>, <Thread(tpool_thread_4, started daemon 135438737053376)>, <Thread(tpool_thread_5, started daemon 135438728660672)>, <Thread(tpool_thread_6, started daemon 135438720267968)>, <Thread(tpool_thread_7, started daemon 135438711875264)>, <Thread(tpool_thread_8, started daemon 135438703466176)>, <Thread(tpool_thread_9, started daemon 135438695057088)>, <Thread(tpool_thread_10, started daemon 135438686648000)>, <Thread(tpool_thread_11, started daemon 135438678238912)>, <Thread(tpool_thread_12, started daemon 135438669829824)>, <Thread(tpool_thread_13, started daemon 135438661420736)>, <Thread(tpool_thread_14, started daemon 135438653011648)>, <Thread(tpool_thread_15, started daemon 135438644602560)>, <Thread(tpool_thread_16, started daemon 135438636193472)>, <Thread(tpool_thread_17, started daemon 135438627784384)>, <Thread(tpool_thread_18, started daemon 135438619375296)>, <Thread(tpool_thread_19, started daemon 135438610966208)>, <Thread(Rabbit-heartbeat, started daemon 135438772197760)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:19:08 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-38ad02e2-9441-478e-98c6-d85323971ae0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Acquiring lock "cinder-bff45b16-4271-4eb4-a775-08f15d629ab1-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:19:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-4611f04a-9902-4718-847f-547250ed28a3 req-d231a061-6d36-49d9-b5a5-440018cc3754 tempest-TestStampPattern-1514829522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:19:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-4611f04a-9902-4718-847f-547250ed28a3 req-d231a061-6d36-49d9-b5a5-440018cc3754 tempest-TestStampPattern-1514829522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:19:08 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-38ad02e2-9441-478e-98c6-d85323971ae0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Lock "cinder-bff45b16-4271-4eb4-a775-08f15d629ab1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:19:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-4611f04a-9902-4718-847f-547250ed28a3 req-d231a061-6d36-49d9-b5a5-440018cc3754 tempest-TestStampPattern-1514829522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:19:08 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-38ad02e2-9441-478e-98c6-d85323971ae0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Acquiring lock "cinder-quobyte-bff45b16-4271-4eb4-a775-08f15d629ab1" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:19:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-4611f04a-9902-4718-847f-547250ed28a3 req-d231a061-6d36-49d9-b5a5-440018cc3754 tempest-TestStampPattern-1514829522 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-257dc82e-c306-4b26-8637-3c547750c374', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e093140a-637d-41bf-85b7-302d7bbfd761', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:19:08 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-38ad02e2-9441-478e-98c6-d85323971ae0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Lock "cinder-quobyte-bff45b16-4271-4eb4-a775-08f15d629ab1" acquired by "delete_volume" :: waited 0.029s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:19:08 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d11a8e7-b3fd-4b81-ab5d-ea147157b265]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:19:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-38ad02e2-9441-478e-98c6-d85323971ae0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bff45b16-4271-4eb4-a775-08f15d629ab1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:08 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-4611f04a-9902-4718-847f-547250ed28a3 req-d231a061-6d36-49d9-b5a5-440018cc3754 tempest-TestStampPattern-1514829522 None] attachment_update completed successfully.
Sep 16 16:19:08 devstack sudo[99189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bff45b16-4271-4eb4-a775-08f15d629ab1
Sep 16 16:19:08 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:08 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-38ad02e2-9441-478e-98c6-d85323971ae0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bff45b16-4271-4eb4-a775-08f15d629ab1" returned: 0 in 0.685s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-38ad02e2-9441-478e-98c6-d85323971ae0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bff45b16-4271-4eb4-a775-08f15d629ab1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:09 devstack sudo[99196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bff45b16-4271-4eb4-a775-08f15d629ab1
Sep 16 16:19:09 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Flow 'volume_create_manager' (99dfc0a8-48ca-4b67-82e6-3ab0e5e0dc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2407a1d-df0e-43c8-a9a4-1c0ef765ce37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2407a1d-df0e-43c8-a9a4-1c0ef765ce37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-914279356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e47d045-775d-4093-8c3d-ffe4381766e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655dd665afcd4172a39780dd743164fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:19:09Z,use_quota=True,user_id='cfdb3b4b1c9642aaa2b296e42160c1f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542493b6-88c5-4e12-9e4c-cbfa044dfbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542493b6-88c5-4e12-9e4c-cbfa044dfbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7134eb60-bd36-4442-bcdd-9259d48b6c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7134eb60-bd36-4442-bcdd-9259d48b6c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e47d045-775d-4093-8c3d-ffe4381766e4', 'volume_name': 'volume-9e47d045-775d-4093-8c3d-ffe4381766e4', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4283b3-d04e-4b5c-96d9-05a67911ecd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:19:09 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4283b3-d04e-4b5c-96d9-05a67911ecd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (146c805b-f65a-4bbb-827c-9114276fc605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:19:09 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Volume 9e47d045-775d-4093-8c3d-ffe4381766e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e47d045-775d-4093-8c3d-ffe4381766e4', 'volume_size': 1}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-914279356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e47d045-775d-4093-8c3d-ffe4381766e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655dd665afcd4172a39780dd743164fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:19:09Z,use_quota=True,user_id='cfdb3b4b1c9642aaa2b296e42160c1f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Creating volume 9e47d045-775d-4093-8c3d-ffe4381766e4 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:19:09 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-38ad02e2-9441-478e-98c6-d85323971ae0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bff45b16-4271-4eb4-a775-08f15d629ab1" returned: 0 in 0.395s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:09 devstack sudo[99223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4 1073741824
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-38ad02e2-9441-478e-98c6-d85323971ae0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Lock "cinder-quobyte-bff45b16-4271-4eb4-a775-08f15d629ab1" released by "delete_volume" :: held 1.144s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:09 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-38ad02e2-9441-478e-98c6-d85323971ae0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Created reservations ['dcb4f585-4416-45a6-b348-cd4edafd0803', 'd31aeb8a-3427-44c4-84f9-a9d60e0d1bcf', 'fa8b56ac-5ea8-48ac-9640-998bfba61e1f', 'ccf626fa-b533-4bd2-a9a9-724a241bb793'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-38ad02e2-9441-478e-98c6-d85323971ae0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-38ad02e2-9441-478e-98c6-d85323971ae0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-38ad02e2-9441-478e-98c6-d85323971ae0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-38ad02e2-9441-478e-98c6-d85323971ae0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-38ad02e2-9441-478e-98c6-d85323971ae0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-38ad02e2-9441-478e-98c6-d85323971ae0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:09 devstack sudo[99225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:19:09 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:09 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4 1073741824" returned: 0 in 0.544s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:09 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-38ad02e2-9441-478e-98c6-d85323971ae0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.288s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-38ad02e2-9441-478e-98c6-d85323971ae0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:19:09 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-38ad02e2-9441-478e-98c6-d85323971ae0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Deleted volume successfully.
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-38ad02e2-9441-478e-98c6-d85323971ae0 tempest-TestServerVolumeAttachScenarioOldVersion-1373663225 None] Lock "cinder-bff45b16-4271-4eb4-a775-08f15d629ab1-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:09 devstack sudo[99232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4
Sep 16 16:19:09 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:10 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4" returned: 0 in 0.260s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:19:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:19:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (146c805b-f65a-4bbb-827c-9114276fc605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e47d045-775d-4093-8c3d-ffe4381766e4', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:19:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f9fb18-3fe3-4595-b442-eb9836c328a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:19:10 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Volume volume-9e47d045-775d-4093-8c3d-ffe4381766e4 (9e47d045-775d-4093-8c3d-ffe4381766e4): created successfully
Sep 16 16:19:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f9fb18-3fe3-4595-b442-eb9836c328a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:19:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Flow 'volume_create_manager' (99dfc0a8-48ca-4b67-82e6-3ab0e5e0dc66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:19:10 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b735aec9-1b5a-4370-a946-3fae8a066b6e tempest-VolumeDependencyTests-409641746 None] Created volume successfully.
Sep 16 16:19:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ff490662-0272-40c4-9fb9-731f519faf89 tempest-VolumeDependencyTests-409641746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:19:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ff490662-0272-40c4-9fb9-731f519faf89 tempest-VolumeDependencyTests-409641746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:19:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-ff490662-0272-40c4-9fb9-731f519faf89 tempest-VolumeDependencyTests-409641746 None] Creating offline snapshot f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b of volume 9e47d045-775d-4093-8c3d-ffe4381766e4 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:19:11 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1e3000-66ba-4821-8f1e-46a8cc96cc95]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:19:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff490662-0272-40c4-9fb9-731f519faf89 tempest-VolumeDependencyTests-409641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:11 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-08621f5d-6307-44ba-8469-dab11d698135 req-4d80e5bf-b2d4-46d8-a886-67a1d245ddeb tempest-TestStampPattern-1514829522 None] Terminate volume connection completed successfully.
Sep 16 16:19:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-08621f5d-6307-44ba-8469-dab11d698135 req-4d80e5bf-b2d4-46d8-a886-67a1d245ddeb tempest-TestStampPattern-1514829522 None] Deleting attachment e093140a-637d-41bf-85b7-302d7bbfd761. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:19:11 devstack sudo[99276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4
Sep 16 16:19:11 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:12 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff490662-0272-40c4-9fb9-731f519faf89 tempest-VolumeDependencyTests-409641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4" returned: 0 in 0.467s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff490662-0272-40c4-9fb9-731f519faf89 tempest-VolumeDependencyTests-409641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:12 devstack sudo[99283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b 1G
Sep 16 16:19:12 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:12 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff490662-0272-40c4-9fb9-731f519faf89 tempest-VolumeDependencyTests-409641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b 1G" returned: 0 in 0.571s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff490662-0272-40c4-9fb9-731f519faf89 tempest-VolumeDependencyTests-409641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e47d045-775d-4093-8c3d-ffe4381766e4 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:12 devstack sudo[99297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e47d045-775d-4093-8c3d-ffe4381766e4 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b
Sep 16 16:19:12 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:13 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff490662-0272-40c4-9fb9-731f519faf89 tempest-VolumeDependencyTests-409641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e47d045-775d-4093-8c3d-ffe4381766e4 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b" returned: 0 in 0.415s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:13 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-ff490662-0272-40c4-9fb9-731f519faf89 tempest-VolumeDependencyTests-409641746 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b is being set with open permissions: ugo+rw
Sep 16 16:19:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff490662-0272-40c4-9fb9-731f519faf89 tempest-VolumeDependencyTests-409641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:13 devstack sudo[99307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b
Sep 16 16:19:13 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:13 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff490662-0272-40c4-9fb9-731f519faf89 tempest-VolumeDependencyTests-409641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b" returned: 0 in 0.291s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff490662-0272-40c4-9fb9-731f519faf89 tempest-VolumeDependencyTests-409641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:13 devstack sudo[99312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.info
Sep 16 16:19:13 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:13 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff490662-0272-40c4-9fb9-731f519faf89 tempest-VolumeDependencyTests-409641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.info" returned: 0 in 0.326s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:13 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-ff490662-0272-40c4-9fb9-731f519faf89 tempest-VolumeDependencyTests-409641746 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.info is being set with open permissions: ugo+rw
Sep 16 16:19:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff490662-0272-40c4-9fb9-731f519faf89 tempest-VolumeDependencyTests-409641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:13 devstack sudo[99323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.info
Sep 16 16:19:13 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:14 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff490662-0272-40c4-9fb9-731f519faf89 tempest-VolumeDependencyTests-409641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.info" returned: 0 in 0.352s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ff490662-0272-40c4-9fb9-731f519faf89 tempest-VolumeDependencyTests-409641746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.576s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:19:14 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-ff490662-0272-40c4-9fb9-731f519faf89 tempest-VolumeDependencyTests-409641746 None] Create snapshot completed successfully
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Flow 'volume_create_manager' (bd7396e0-59b9-47be-af9d-c6c6b28463bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413a8b8f-d057-4aaf-92d9-d76c919dd259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413a8b8f-d057-4aaf-92d9-d76c919dd259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-113382270',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c60f0d0-001e-44a7-aaf4-61ed25e00ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655dd665afcd4172a39780dd743164fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:19:16Z,use_quota=True,user_id='cfdb3b4b1c9642aaa2b296e42160c1f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6e8850-7426-46e3-8fd3-0efce3d91ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6e8850-7426-46e3-8fd3-0efce3d91ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8475a489-5a21-469c-b9bd-2108ae870256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8475a489-5a21-469c-b9bd-2108ae870256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1c60f0d0-001e-44a7-aaf4-61ed25e00ebc', 'volume_name': 'volume-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc', 'volume_size': 1, 'snapshot_id': 'f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b'}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3e7e66-68b9-4b5a-b523-a967d9fd5dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3e7e66-68b9-4b5a-b523-a967d9fd5dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871d9f7a-e8c7-46ac-ac82-8cf756247a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:19:15 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Volume 1c60f0d0-001e-44a7-aaf4-61ed25e00ebc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc', 'volume_size': 1, 'snapshot_id': 'f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b'}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Acquiring lock "cinder-quobyte-f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc" by "_create_volume_from_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Lock "cinder-quobyte-f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Creating volume 1c60f0d0-001e-44a7-aaf4-61ed25e00ebc from snapshot f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b {{(pid=86165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Acquiring lock "cinder-quobyte-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc" by "_copy_volume_from_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Lock "cinder-quobyte-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] snapshot: f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b, volume: 1c60f0d0-001e-44a7-aaf4-61ed25e00ebc,  {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ac8e0a-1af3-436d-83e4-7e3bf3b70b03]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:19:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:15 devstack sudo[99342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b
Sep 16 16:19:15 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:16 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b" returned: 0 in 0.474s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e47d045-775d-4093-8c3d-ffe4381766e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:19:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-371e918c-dc0a-435b-af7b-4ffec3eef449 tempest-TestStampPattern-1514829522 None] Acquiring lock "cinder-257dc82e-c306-4b26-8637-3c547750c374-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:19:16 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9f1e9b-ff86-4ea3-b91b-ea7c98ea0166]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:19:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-371e918c-dc0a-435b-af7b-4ffec3eef449 tempest-TestStampPattern-1514829522 None] Lock "cinder-257dc82e-c306-4b26-8637-3c547750c374-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:19:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-371e918c-dc0a-435b-af7b-4ffec3eef449 tempest-TestStampPattern-1514829522 None] Acquiring lock "cinder-quobyte-257dc82e-c306-4b26-8637-3c547750c374" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:19:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-371e918c-dc0a-435b-af7b-4ffec3eef449 tempest-TestStampPattern-1514829522 None] Lock "cinder-quobyte-257dc82e-c306-4b26-8637-3c547750c374" acquired by "delete_volume" :: waited 0.051s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:19:16 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[460e4b2e-4af9-4495-a097-629604c97cb0]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:19:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-371e918c-dc0a-435b-af7b-4ffec3eef449 tempest-TestStampPattern-1514829522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-257dc82e-c306-4b26-8637-3c547750c374 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:16 devstack sudo[99348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4
Sep 16 16:19:16 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:16 devstack sudo[99349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-257dc82e-c306-4b26-8637-3c547750c374
Sep 16 16:19:16 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:16 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4" returned: 0 in 0.533s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] will copy from snapshot at /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4 {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 16:19:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Creating direct copy from snapshot {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 16:19:16 devstack cinder-volume[86165]: DEBUG cinder.utils [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Path /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc not found in is_blk_device check {{(pid=86165) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 16:19:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:16 devstack sudo[99355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc
Sep 16 16:19:16 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:17 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-371e918c-dc0a-435b-af7b-4ffec3eef449 tempest-TestStampPattern-1514829522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-257dc82e-c306-4b26-8637-3c547750c374" returned: 0 in 0.409s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-371e918c-dc0a-435b-af7b-4ffec3eef449 tempest-TestStampPattern-1514829522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-257dc82e-c306-4b26-8637-3c547750c374 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:17 devstack sudo[99360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-257dc82e-c306-4b26-8637-3c547750c374
Sep 16 16:19:17 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:17 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-371e918c-dc0a-435b-af7b-4ffec3eef449 tempest-TestStampPattern-1514829522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-257dc82e-c306-4b26-8637-3c547750c374" returned: 0 in 0.337s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-371e918c-dc0a-435b-af7b-4ffec3eef449 tempest-TestStampPattern-1514829522 None] Lock "cinder-quobyte-257dc82e-c306-4b26-8637-3c547750c374" released by "delete_volume" :: held 0.819s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:17 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-371e918c-dc0a-435b-af7b-4ffec3eef449 tempest-TestStampPattern-1514829522 None] Created reservations ['116fa7cb-6b90-4f4d-86da-b4ab9fecd8fe', '66292c18-2646-47bb-a91e-7a46748704cc', '7d239ea4-e80c-440f-b008-a4cc96a35b76', '5492c13d-9c20-4199-8012-3d4a93121c25'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:19:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-371e918c-dc0a-435b-af7b-4ffec3eef449 tempest-TestStampPattern-1514829522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:19:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-371e918c-dc0a-435b-af7b-4ffec3eef449 tempest-TestStampPattern-1514829522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:19:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-371e918c-dc0a-435b-af7b-4ffec3eef449 tempest-TestStampPattern-1514829522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:19:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-371e918c-dc0a-435b-af7b-4ffec3eef449 tempest-TestStampPattern-1514829522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:19:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-371e918c-dc0a-435b-af7b-4ffec3eef449 tempest-TestStampPattern-1514829522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:19:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-371e918c-dc0a-435b-af7b-4ffec3eef449 tempest-TestStampPattern-1514829522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:17 devstack sudo[99374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:19:17 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:18 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-371e918c-dc0a-435b-af7b-4ffec3eef449 tempest-TestStampPattern-1514829522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.552s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:18 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-371e918c-dc0a-435b-af7b-4ffec3eef449 tempest-TestStampPattern-1514829522 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:19:18 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-371e918c-dc0a-435b-af7b-4ffec3eef449 tempest-TestStampPattern-1514829522 None] Deleted volume successfully.
Sep 16 16:19:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-371e918c-dc0a-435b-af7b-4ffec3eef449 tempest-TestStampPattern-1514829522 None] Lock "cinder-257dc82e-c306-4b26-8637-3c547750c374-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-835edf8b-6933-49b3-bb10-3c86bf4c8104 tempest-TestStampPattern-1514829522 None] Acquiring lock "cinder-8a6f1730-e9d7-4ffa-87e5-db577eb533f2-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:19:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-835edf8b-6933-49b3-bb10-3c86bf4c8104 tempest-TestStampPattern-1514829522 None] Lock "cinder-8a6f1730-e9d7-4ffa-87e5-db577eb533f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:19:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-835edf8b-6933-49b3-bb10-3c86bf4c8104 tempest-TestStampPattern-1514829522 None] Acquiring lock "cinder-quobyte-117a963f-d658-4f2b-8f8a-4947c505277c" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:19:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-835edf8b-6933-49b3-bb10-3c86bf4c8104 tempest-TestStampPattern-1514829522 None] Lock "cinder-quobyte-117a963f-d658-4f2b-8f8a-4947c505277c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:19:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-835edf8b-6933-49b3-bb10-3c86bf4c8104 tempest-TestStampPattern-1514829522 None] Acquiring lock "cinder-quobyte-8a6f1730-e9d7-4ffa-87e5-db577eb533f2" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:19:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-835edf8b-6933-49b3-bb10-3c86bf4c8104 tempest-TestStampPattern-1514829522 None] Lock "cinder-quobyte-8a6f1730-e9d7-4ffa-87e5-db577eb533f2" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:19:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-835edf8b-6933-49b3-bb10-3c86bf4c8104 tempest-TestStampPattern-1514829522 None] Deleting offline snapshot 8a6f1730-e9d7-4ffa-87e5-db577eb533f2 of volume 117a963f-d658-4f2b-8f8a-4947c505277c {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:19:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-835edf8b-6933-49b3-bb10-3c86bf4c8104 tempest-TestStampPattern-1514829522 None] snapshot_file for this snap is: volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:19:18 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2dfe07-d5d7-4ea3-adec-1ee1707940c7]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:19:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-835edf8b-6933-49b3-bb10-3c86bf4c8104 tempest-TestStampPattern-1514829522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:19 devstack sudo[99379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2
Sep 16 16:19:19 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:19 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-835edf8b-6933-49b3-bb10-3c86bf4c8104 tempest-TestStampPattern-1514829522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2" returned: 0 in 1.122s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-835edf8b-6933-49b3-bb10-3c86bf4c8104 tempest-TestStampPattern-1514829522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-117a963f-d658-4f2b-8f8a-4947c505277c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:19:19 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5b94d0-255f-4a30-898a-44ba7e04d920]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:19:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-835edf8b-6933-49b3-bb10-3c86bf4c8104 tempest-TestStampPattern-1514829522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:20 devstack sudo[99405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c
Sep 16 16:19:20 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:21 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-835edf8b-6933-49b3-bb10-3c86bf4c8104 tempest-TestStampPattern-1514829522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c" returned: 0 in 1.245s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-835edf8b-6933-49b3-bb10-3c86bf4c8104 tempest-TestStampPattern-1514829522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:21 devstack sudo[99415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2
Sep 16 16:19:21 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:21 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-835edf8b-6933-49b3-bb10-3c86bf4c8104 tempest-TestStampPattern-1514829522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2" returned: 0 in 0.705s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-835edf8b-6933-49b3-bb10-3c86bf4c8104 tempest-TestStampPattern-1514829522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:21 devstack sudo[99422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2
Sep 16 16:19:21 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:22 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-835edf8b-6933-49b3-bb10-3c86bf4c8104 tempest-TestStampPattern-1514829522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c.8a6f1730-e9d7-4ffa-87e5-db577eb533f2" returned: 0 in 0.614s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-835edf8b-6933-49b3-bb10-3c86bf4c8104 tempest-TestStampPattern-1514829522 None] Lock "cinder-quobyte-8a6f1730-e9d7-4ffa-87e5-db577eb533f2" released by "_delete_snapshot" :: held 3.980s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-835edf8b-6933-49b3-bb10-3c86bf4c8104 tempest-TestStampPattern-1514829522 None] Lock "cinder-quobyte-117a963f-d658-4f2b-8f8a-4947c505277c" released by "delete_snapshot" :: held 4.021s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:22 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-835edf8b-6933-49b3-bb10-3c86bf4c8104 tempest-TestStampPattern-1514829522 None] Created reservations ['bfc98b86-f76b-442e-bd0c-aa0c08f16cea', '4d554220-2966-45a6-9330-de4dc47276bd', '2d0c1514-93c2-48be-af4e-550d247b5254', 'c8ea9d59-9f2f-4a9a-9c2e-b407458aab71'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:19:22 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-835edf8b-6933-49b3-bb10-3c86bf4c8104 tempest-TestStampPattern-1514829522 None] Delete snapshot completed successfully.
Sep 16 16:19:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-835edf8b-6933-49b3-bb10-3c86bf4c8104 tempest-TestStampPattern-1514829522 None] Lock "cinder-8a6f1730-e9d7-4ffa-87e5-db577eb533f2-delete_snapshot" released by "delete_snapshot" :: held 4.392s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:26 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc" returned: 0 in 9.234s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:26 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Image conversion details: src /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4, size 1024.00 MB, duration 9.24 sec, destination /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:19:26 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Converted 1024.00 MB image at 110.88 MB/s
Sep 16 16:19:26 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc is being set with open permissions: ugo+rw
Sep 16 16:19:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:26 devstack sudo[99428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc
Sep 16 16:19:26 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:26 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc" returned: 0 in 0.289s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Lock "cinder-quobyte-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc" released by "_copy_volume_from_snapshot" :: held 10.685s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Lock "cinder-quobyte-f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc" released by "_create_volume_from_snapshot" :: held 10.765s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.791s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:19:26 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871d9f7a-e8c7-46ac-ac82-8cf756247a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc', 'volume_size': 1, 'snapshot_id': 'f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b'}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:19:26 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c05f1a-a84a-4253-9f97-877b032dd91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:19:26 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Volume volume-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc (1c60f0d0-001e-44a7-aaf4-61ed25e00ebc): created successfully
Sep 16 16:19:26 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c05f1a-a84a-4253-9f97-877b032dd91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:19:26 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Flow 'volume_create_manager' (bd7396e0-59b9-47be-af9d-c6c6b28463bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:19:26 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-3a5ae869-b54d-4061-86b4-a45ea628ff9d tempest-VolumeDependencyTests-409641746 None] Created volume successfully.
Sep 16 16:19:27 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-82b04119-918b-4d0a-8a26-4708bae31e4c tempest-VolumeDependencyTests-409641746 None] Acquiring lock "cinder-f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:19:27 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-82b04119-918b-4d0a-8a26-4708bae31e4c tempest-VolumeDependencyTests-409641746 None] Lock "cinder-f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:19:27 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-82b04119-918b-4d0a-8a26-4708bae31e4c tempest-VolumeDependencyTests-409641746 None] Acquiring lock "cinder-quobyte-9e47d045-775d-4093-8c3d-ffe4381766e4" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:19:27 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-82b04119-918b-4d0a-8a26-4708bae31e4c tempest-VolumeDependencyTests-409641746 None] Lock "cinder-quobyte-9e47d045-775d-4093-8c3d-ffe4381766e4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:19:27 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-82b04119-918b-4d0a-8a26-4708bae31e4c tempest-VolumeDependencyTests-409641746 None] Acquiring lock "cinder-quobyte-f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:19:27 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-82b04119-918b-4d0a-8a26-4708bae31e4c tempest-VolumeDependencyTests-409641746 None] Lock "cinder-quobyte-f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:19:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-82b04119-918b-4d0a-8a26-4708bae31e4c tempest-VolumeDependencyTests-409641746 None] Deleting offline snapshot f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b of volume 9e47d045-775d-4093-8c3d-ffe4381766e4 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:19:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-82b04119-918b-4d0a-8a26-4708bae31e4c tempest-VolumeDependencyTests-409641746 None] snapshot_file for this snap is: volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:19:27 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ace9b12-c959-4963-bb48-52b522208be9]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:19:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-82b04119-918b-4d0a-8a26-4708bae31e4c tempest-VolumeDependencyTests-409641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:27 devstack sudo[99436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b
Sep 16 16:19:27 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:27 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-82b04119-918b-4d0a-8a26-4708bae31e4c tempest-VolumeDependencyTests-409641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b" returned: 0 in 0.646s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-82b04119-918b-4d0a-8a26-4708bae31e4c tempest-VolumeDependencyTests-409641746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e47d045-775d-4093-8c3d-ffe4381766e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:19:27 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[17831304-27f0-4c12-ac47-cdf41359c6c4]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:19:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-82b04119-918b-4d0a-8a26-4708bae31e4c tempest-VolumeDependencyTests-409641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:27 devstack sudo[99461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4
Sep 16 16:19:27 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:28 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-82b04119-918b-4d0a-8a26-4708bae31e4c tempest-VolumeDependencyTests-409641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4" returned: 0 in 0.631s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-82b04119-918b-4d0a-8a26-4708bae31e4c tempest-VolumeDependencyTests-409641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:28 devstack sudo[99467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b
Sep 16 16:19:28 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:28 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-82b04119-918b-4d0a-8a26-4708bae31e4c tempest-VolumeDependencyTests-409641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b" returned: 0 in 0.539s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-82b04119-918b-4d0a-8a26-4708bae31e4c tempest-VolumeDependencyTests-409641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:29 devstack sudo[99488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b
Sep 16 16:19:29 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:29 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-82b04119-918b-4d0a-8a26-4708bae31e4c tempest-VolumeDependencyTests-409641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4.f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b" returned: 0 in 0.323s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:29 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=103,cinder:SELECT=105,cinder:INSERT=16,cinder:DELETE=14 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:19:29 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=85,cinder:UPDATE=114,cinder:INSERT=32,cinder:DELETE=6 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:19:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-82b04119-918b-4d0a-8a26-4708bae31e4c tempest-VolumeDependencyTests-409641746 None] Lock "cinder-quobyte-f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b" released by "_delete_snapshot" :: held 2.313s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-82b04119-918b-4d0a-8a26-4708bae31e4c tempest-VolumeDependencyTests-409641746 None] Lock "cinder-quobyte-9e47d045-775d-4093-8c3d-ffe4381766e4" released by "delete_snapshot" :: held 2.350s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:29 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-82b04119-918b-4d0a-8a26-4708bae31e4c tempest-VolumeDependencyTests-409641746 None] Created reservations ['5f3092b6-2f71-4cd8-be07-7f91b254b42e', 'b6b1e295-dc22-4a21-b0f7-23164e3f2d63', '7184c3be-0ced-4650-8a60-af60aa7e38b5', '6fed189a-8c68-4450-85b6-3fef3309f5c7'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:19:29 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-82b04119-918b-4d0a-8a26-4708bae31e4c tempest-VolumeDependencyTests-409641746 None] Delete snapshot completed successfully.
Sep 16 16:19:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-82b04119-918b-4d0a-8a26-4708bae31e4c tempest-VolumeDependencyTests-409641746 None] Lock "cinder-f2f1cb92-a8f8-47cf-98eb-33a0fb48cc8b-delete_snapshot" released by "delete_snapshot" :: held 2.590s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e30316c7-ae15-433c-925f-5bb8868ba87f tempest-VolumeDependencyTests-409641746 None] Acquiring lock "cinder-9e47d045-775d-4093-8c3d-ffe4381766e4-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:19:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f6bf4b26-de3b-46cb-adca-a8750c06aa1b tempest-TestStampPattern-1514829522 None] Acquiring lock "cinder-117a963f-d658-4f2b-8f8a-4947c505277c-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:19:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e30316c7-ae15-433c-925f-5bb8868ba87f tempest-VolumeDependencyTests-409641746 None] Lock "cinder-9e47d045-775d-4093-8c3d-ffe4381766e4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:19:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f6bf4b26-de3b-46cb-adca-a8750c06aa1b tempest-TestStampPattern-1514829522 None] Lock "cinder-117a963f-d658-4f2b-8f8a-4947c505277c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:19:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e30316c7-ae15-433c-925f-5bb8868ba87f tempest-VolumeDependencyTests-409641746 None] Acquiring lock "cinder-quobyte-9e47d045-775d-4093-8c3d-ffe4381766e4" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:19:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f6bf4b26-de3b-46cb-adca-a8750c06aa1b tempest-TestStampPattern-1514829522 None] Acquiring lock "cinder-quobyte-117a963f-d658-4f2b-8f8a-4947c505277c" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:19:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e30316c7-ae15-433c-925f-5bb8868ba87f tempest-VolumeDependencyTests-409641746 None] Lock "cinder-quobyte-9e47d045-775d-4093-8c3d-ffe4381766e4" acquired by "delete_volume" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:19:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f6bf4b26-de3b-46cb-adca-a8750c06aa1b tempest-TestStampPattern-1514829522 None] Lock "cinder-quobyte-117a963f-d658-4f2b-8f8a-4947c505277c" acquired by "delete_volume" :: waited 0.062s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:19:30 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b317f4-be38-4d5a-b049-de9efc0b48e2]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:19:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e30316c7-ae15-433c-925f-5bb8868ba87f tempest-VolumeDependencyTests-409641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:30 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c98a95e-09d3-4dbc-affc-4d236c843595]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:19:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f6bf4b26-de3b-46cb-adca-a8750c06aa1b tempest-TestStampPattern-1514829522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:30 devstack sudo[99493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c
Sep 16 16:19:30 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:30 devstack sudo[99492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4
Sep 16 16:19:30 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:30 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-07182517-abbc-4db1-8ccc-79149ffd51fe req-16fd1879-616f-48b6-a585-573492884b2c tempest-AttachVolumeNegativeTest-909556830 None] Terminate volume connection completed successfully.
Sep 16 16:19:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-07182517-abbc-4db1-8ccc-79149ffd51fe req-16fd1879-616f-48b6-a585-573492884b2c tempest-AttachVolumeNegativeTest-909556830 None] Deleting attachment 7d01b7d5-11b2-4390-8158-62510f41b710. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:19:31 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f6bf4b26-de3b-46cb-adca-a8750c06aa1b tempest-TestStampPattern-1514829522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c" returned: 0 in 0.505s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f6bf4b26-de3b-46cb-adca-a8750c06aa1b tempest-TestStampPattern-1514829522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:31 devstack sudo[99505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c
Sep 16 16:19:31 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:31 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e30316c7-ae15-433c-925f-5bb8868ba87f tempest-VolumeDependencyTests-409641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4" returned: 0 in 0.610s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e30316c7-ae15-433c-925f-5bb8868ba87f tempest-VolumeDependencyTests-409641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:31 devstack sudo[99508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4
Sep 16 16:19:31 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:31 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f6bf4b26-de3b-46cb-adca-a8750c06aa1b tempest-TestStampPattern-1514829522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-117a963f-d658-4f2b-8f8a-4947c505277c" returned: 0 in 0.301s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f6bf4b26-de3b-46cb-adca-a8750c06aa1b tempest-TestStampPattern-1514829522 None] Lock "cinder-quobyte-117a963f-d658-4f2b-8f8a-4947c505277c" released by "delete_volume" :: held 0.910s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:31 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e30316c7-ae15-433c-925f-5bb8868ba87f tempest-VolumeDependencyTests-409641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9e47d045-775d-4093-8c3d-ffe4381766e4" returned: 0 in 0.303s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e30316c7-ae15-433c-925f-5bb8868ba87f tempest-VolumeDependencyTests-409641746 None] Lock "cinder-quobyte-9e47d045-775d-4093-8c3d-ffe4381766e4" released by "delete_volume" :: held 1.048s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:31 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-f6bf4b26-de3b-46cb-adca-a8750c06aa1b tempest-TestStampPattern-1514829522 None] Created reservations ['4ec6d022-5c56-45b3-bdcb-dcf03712b8e6', '35e79f5b-d7e7-4dda-8874-aed90ffc195c', 'a6d2e046-15e6-479c-981e-af83bd49d6b8', '3b18c5c5-d8ed-49f0-b8c7-fcf36f75942f'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:19:31 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-e30316c7-ae15-433c-925f-5bb8868ba87f tempest-VolumeDependencyTests-409641746 None] Created reservations ['0ea8f08e-d7e0-4ec3-842c-89a027ae6a68', '21ea7779-a843-4758-8304-beb4afc54888', '709b07c4-f812-454b-b7bc-9c448c475c94', '4d62ea3d-832d-4407-a9b3-2b2bc0a7796d'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:19:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f6bf4b26-de3b-46cb-adca-a8750c06aa1b tempest-TestStampPattern-1514829522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:19:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f6bf4b26-de3b-46cb-adca-a8750c06aa1b tempest-TestStampPattern-1514829522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:19:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-f6bf4b26-de3b-46cb-adca-a8750c06aa1b tempest-TestStampPattern-1514829522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:19:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-f6bf4b26-de3b-46cb-adca-a8750c06aa1b tempest-TestStampPattern-1514829522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:19:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f6bf4b26-de3b-46cb-adca-a8750c06aa1b tempest-TestStampPattern-1514829522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:19:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f6bf4b26-de3b-46cb-adca-a8750c06aa1b tempest-TestStampPattern-1514829522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:31 devstack sudo[99512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:19:31 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e30316c7-ae15-433c-925f-5bb8868ba87f tempest-VolumeDependencyTests-409641746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:19:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e30316c7-ae15-433c-925f-5bb8868ba87f tempest-VolumeDependencyTests-409641746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:19:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e30316c7-ae15-433c-925f-5bb8868ba87f tempest-VolumeDependencyTests-409641746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:19:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e30316c7-ae15-433c-925f-5bb8868ba87f tempest-VolumeDependencyTests-409641746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:19:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e30316c7-ae15-433c-925f-5bb8868ba87f tempest-VolumeDependencyTests-409641746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:19:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e30316c7-ae15-433c-925f-5bb8868ba87f tempest-VolumeDependencyTests-409641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:31 devstack sudo[99514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:19:31 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:32 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e30316c7-ae15-433c-925f-5bb8868ba87f tempest-VolumeDependencyTests-409641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.405s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:32 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-e30316c7-ae15-433c-925f-5bb8868ba87f tempest-VolumeDependencyTests-409641746 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:19:32 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f6bf4b26-de3b-46cb-adca-a8750c06aa1b tempest-TestStampPattern-1514829522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.522s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:32 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-e30316c7-ae15-433c-925f-5bb8868ba87f tempest-VolumeDependencyTests-409641746 None] Deleted volume successfully.
Sep 16 16:19:32 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-f6bf4b26-de3b-46cb-adca-a8750c06aa1b tempest-TestStampPattern-1514829522 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:19:32 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-f6bf4b26-de3b-46cb-adca-a8750c06aa1b tempest-TestStampPattern-1514829522 None] Deleted volume successfully.
Sep 16 16:19:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f6bf4b26-de3b-46cb-adca-a8750c06aa1b tempest-TestStampPattern-1514829522 None] Lock "cinder-117a963f-d658-4f2b-8f8a-4947c505277c-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e30316c7-ae15-433c-925f-5bb8868ba87f tempest-VolumeDependencyTests-409641746 None] Lock "cinder-9e47d045-775d-4093-8c3d-ffe4381766e4-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4095309d-dac2-47bd-8aec-31072930742a tempest-VolumeDependencyTests-409641746 None] Acquiring lock "cinder-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:19:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4095309d-dac2-47bd-8aec-31072930742a tempest-VolumeDependencyTests-409641746 None] Lock "cinder-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:19:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4095309d-dac2-47bd-8aec-31072930742a tempest-VolumeDependencyTests-409641746 None] Acquiring lock "cinder-quobyte-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:19:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4095309d-dac2-47bd-8aec-31072930742a tempest-VolumeDependencyTests-409641746 None] Lock "cinder-quobyte-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc" acquired by "delete_volume" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:19:32 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[50833f1c-42ab-44d4-961e-bfccf6b82238]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:19:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4095309d-dac2-47bd-8aec-31072930742a tempest-VolumeDependencyTests-409641746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:32 devstack sudo[99538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc
Sep 16 16:19:32 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:33 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4095309d-dac2-47bd-8aec-31072930742a tempest-VolumeDependencyTests-409641746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc" returned: 0 in 0.498s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4095309d-dac2-47bd-8aec-31072930742a tempest-VolumeDependencyTests-409641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:33 devstack sudo[99546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc
Sep 16 16:19:33 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:33 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4095309d-dac2-47bd-8aec-31072930742a tempest-VolumeDependencyTests-409641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc" returned: 0 in 0.365s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4095309d-dac2-47bd-8aec-31072930742a tempest-VolumeDependencyTests-409641746 None] Lock "cinder-quobyte-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc" released by "delete_volume" :: held 0.953s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:33 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-4095309d-dac2-47bd-8aec-31072930742a tempest-VolumeDependencyTests-409641746 None] Created reservations ['49ced542-f68c-4816-9919-fcae4d9b74b4', 'c876e852-86c7-4d08-ad9e-7b096b2943fb', '6217b123-9ca3-4bf9-8b71-18da1ccb8a8f', 'a5d2f156-f506-4602-be7c-48a760723acb'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:19:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4095309d-dac2-47bd-8aec-31072930742a tempest-VolumeDependencyTests-409641746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:19:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4095309d-dac2-47bd-8aec-31072930742a tempest-VolumeDependencyTests-409641746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:19:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4095309d-dac2-47bd-8aec-31072930742a tempest-VolumeDependencyTests-409641746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:19:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4095309d-dac2-47bd-8aec-31072930742a tempest-VolumeDependencyTests-409641746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:19:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4095309d-dac2-47bd-8aec-31072930742a tempest-VolumeDependencyTests-409641746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:19:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4095309d-dac2-47bd-8aec-31072930742a tempest-VolumeDependencyTests-409641746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:19:34 devstack sudo[99550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:19:34 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:19:34 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root
Sep 16 16:19:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4095309d-dac2-47bd-8aec-31072930742a tempest-VolumeDependencyTests-409641746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.345s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:19:34 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4095309d-dac2-47bd-8aec-31072930742a tempest-VolumeDependencyTests-409641746 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:19:34 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-4095309d-dac2-47bd-8aec-31072930742a tempest-VolumeDependencyTests-409641746 None] Deleted volume successfully.
Sep 16 16:19:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4095309d-dac2-47bd-8aec-31072930742a tempest-VolumeDependencyTests-409641746 None] Lock "cinder-1c60f0d0-001e-44a7-aaf4-61ed25e00ebc-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:19:43 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=21,cinder:INSERT=8,cinder:UPDATE=30 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:19:44 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=20,cinder:INSERT=8,cinder:UPDATE=29,cinder:DELETE=3 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:20:00 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:20:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Flow 'volume_create_manager' (30416adb-7858-4ab2-a6f2-2c673c266e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:20:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b604e42-db9d-4ca7-9a84-5e0900958fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b604e42-db9d-4ca7-9a84-5e0900958fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d694b0-14c7-4ec6-aa9e-1d0777030a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1826ca1d804c6db8f61d353f2e2ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:00Z,use_quota=True,user_id='d8eb2e8006934bbfaa696794d4a4ecf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a55823f7-57f8-4bc4-8643-d349d42164fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a55823f7-57f8-4bc4-8643-d349d42164fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5a18f8-4edf-478b-bf7d-9de9c2ead09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:00 devstack cinder-volume[86165]: DEBUG cinder.image.glance [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Creating Keystone auth plugin from conf {{(pid=86165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 16:20:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5a18f8-4edf-478b-bf7d-9de9c2ead09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '41d694b0-14c7-4ec6-aa9e-1d0777030a08', 'volume_name': 'volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08', 'volume_size': 1, 'image_id': '5ee9fc91-bc4e-4239-8423-26e386333333', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ee9fc91-bc4e-4239-8423-26e386333333', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '93d3b0739215cdcae9927b694f241b4c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2f1826ca1d804c6db8f61d353f2e2ee6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14196528f3cec77a257083579f83ea78152f34b02822d84f7855f29f6d6696fa7d4cf81975a3386c3adb946b018f09d16aca1545c8df424f707a362e453cc576', 'id': '5ee9fc91-bc4e-4239-8423-26e386333333', 'created_at': datetime.datetime(2026, 9, 16, 14, 19, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 19, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ee9fc91-bc4e-4239-8423-26e386333333/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e41b9d9d0>}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:01 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6002273-366b-4d7a-b768-ff190054ad95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:01 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6002273-366b-4d7a-b768-ff190054ad95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:01 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b28c5b3-07ea-4ddf-b68b-da46847c9261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:01 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Volume 41d694b0-14c7-4ec6-aa9e-1d0777030a08: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08', 'volume_size': 1, 'image_id': '5ee9fc91-bc4e-4239-8423-26e386333333', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ee9fc91-bc4e-4239-8423-26e386333333', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '93d3b0739215cdcae9927b694f241b4c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2f1826ca1d804c6db8f61d353f2e2ee6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14196528f3cec77a257083579f83ea78152f34b02822d84f7855f29f6d6696fa7d4cf81975a3386c3adb946b018f09d16aca1545c8df424f707a362e453cc576', 'id': '5ee9fc91-bc4e-4239-8423-26e386333333', 'created_at': datetime.datetime(2026, 9, 16, 14, 19, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 19, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ee9fc91-bc4e-4239-8423-26e386333333/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e41b9d9d0>}
Sep 16 16:20:01 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Trying to clone 41d694b0-14c7-4ec6-aa9e-1d0777030a08 from image 5ee9fc91-bc4e-4239-8423-26e386333333 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5ee9fc91-bc4e-4239-8423-26e386333333', 'metadata': {}}]). {{(pid=86165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 16:20:01 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 16:20:01 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Image download 0.00 MB at 0.00 MB/s
Sep 16 16:20:01 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e5c78e-8d21-40fd-aa2e-1cb5c8a0f290]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:20:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:01 devstack sudo[99695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD
Sep 16 16:20:01 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:01 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:01 devstack sudo[99699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD
Sep 16 16:20:01 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:01 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:20:01 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Temporary image 5ee9fc91-bc4e-4239-8423-26e386333333 is fetched for user d8eb2e8006934bbfaa696794d4a4ecf8. {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Flow 'volume_create_manager' (9b1158c3-87b9-41d4-8fc5-36f9fb2b6df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (263ac9e2-170e-447f-aea0-c882632e8e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (263ac9e2-170e-447f-aea0-c882632e8e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1322744563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e47864-5a28-422d-82cc-0b2ac645ccc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41013de45b44b07980c55a4ec292b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:02Z,use_quota=True,user_id='84d71361a53741c0a5d5fdf09ded1456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (884676e5-b047-482e-965c-fa530ff97d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (884676e5-b047-482e-965c-fa530ff97d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813a587f-79e3-42c9-93d4-e8ddde91d35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813a587f-79e3-42c9-93d4-e8ddde91d35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52e47864-5a28-422d-82cc-0b2ac645ccc6', 'volume_name': 'volume-52e47864-5a28-422d-82cc-0b2ac645ccc6', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5493d130-f4cd-4e04-a866-99b7fb334381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5493d130-f4cd-4e04-a866-99b7fb334381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (435bb393-7f2e-4807-a86e-2ea095a6066a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:02 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Volume 52e47864-5a28-422d-82cc-0b2ac645ccc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52e47864-5a28-422d-82cc-0b2ac645ccc6', 'volume_size': 1}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1322744563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e47864-5a28-422d-82cc-0b2ac645ccc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41013de45b44b07980c55a4ec292b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:02Z,use_quota=True,user_id='84d71361a53741c0a5d5fdf09ded1456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Creating volume 52e47864-5a28-422d-82cc-0b2ac645ccc6 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:20:02 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[370bc856-c001-4a69-8866-556ed8c1b082]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:02 devstack sudo[99704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6 1073741824
Sep 16 16:20:02 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:02 devstack sudo[99705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD
Sep 16 16:20:02 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:02 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:02 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6 1073741824" returned: 0 in 0.437s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:02 devstack sudo[99714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD
Sep 16 16:20:02 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:02 devstack sudo[99716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6
Sep 16 16:20:02 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:02 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD" returned: 1 in 0.333s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:02 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6" returned: 0 in 0.245s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.026s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d694b0-14c7-4ec6-aa9e-1d0777030a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f1826ca1d804c6db8f61d353f2e2ee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:00Z,use_quota=True,user_id='d8eb2e8006934bbfaa696794d4a4ecf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Creating volume 41d694b0-14c7-4ec6-aa9e-1d0777030a08 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:20:02 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (435bb393-7f2e-4807-a86e-2ea095a6066a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52e47864-5a28-422d-82cc-0b2ac645ccc6', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:02 devstack sudo[99723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08 1073741824
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75264853-68b0-4ac5-bc18-f77b7aab1f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:02 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:02 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Volume volume-52e47864-5a28-422d-82cc-0b2ac645ccc6 (52e47864-5a28-422d-82cc-0b2ac645ccc6): created successfully
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75264853-68b0-4ac5-bc18-f77b7aab1f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Flow 'volume_create_manager' (9b1158c3-87b9-41d4-8fc5-36f9fb2b6df9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:20:02 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-6e9ea8f7-4441-415f-a091-2ded402b1539 tempest-TestImageHashVerification-1308663722 None] Created volume successfully.
Sep 16 16:20:03 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08 1073741824" returned: 0 in 0.519s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:03 devstack sudo[99728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08
Sep 16 16:20:03 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:03 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08" returned: 0 in 0.266s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:03 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:20:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:03 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Attempting download of 5ee9fc91-bc4e-4239-8423-26e386333333 ((None, [{'url': 'file:///opt/stack/data/glance/images/5ee9fc91-bc4e-4239-8423-26e386333333', 'metadata': {}}])) to volume 41d694b0-14c7-4ec6-aa9e-1d0777030a08. {{(pid=86165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 16:20:03 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdc22f1-b18f-4745-8835-099f69511b76]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:20:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ee9fc91-bc4e-4239-8423-26e386333333_bnojxa5x {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:03 devstack sudo[99731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ee9fc91-bc4e-4239-8423-26e386333333_bnojxa5x
Sep 16 16:20:03 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a89485b0-2b56-43fe-a88b-58f7d5c48ca5 tempest-TestImageHashVerification-1308663722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a89485b0-2b56-43fe-a88b-58f7d5c48ca5 tempest-TestImageHashVerification-1308663722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:04 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8825b02-b26c-467b-a12e-3bf7ee554543]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:20:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a89485b0-2b56-43fe-a88b-58f7d5c48ca5 tempest-TestImageHashVerification-1308663722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:04 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ee9fc91-bc4e-4239-8423-26e386333333_bnojxa5x" returned: 0 in 0.342s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ee9fc91-bc4e-4239-8423-26e386333333_bnojxa5x {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:04 devstack sudo[99733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6
Sep 16 16:20:04 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:04 devstack sudo[99736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ee9fc91-bc4e-4239-8423-26e386333333_bnojxa5x
Sep 16 16:20:04 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:04 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a89485b0-2b56-43fe-a88b-58f7d5c48ca5 tempest-TestImageHashVerification-1308663722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6" returned: 0 in 0.412s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:04 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee1edc2-2add-4788-b253-d1c4151f76e9]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:20:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a89485b0-2b56-43fe-a88b-58f7d5c48ca5 tempest-TestImageHashVerification-1308663722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:04 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ee9fc91-bc4e-4239-8423-26e386333333_bnojxa5x" returned: 1 in 0.396s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ee9fc91-bc4e-4239-8423-26e386333333_bnojxa5x' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:20:04 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[62893731-6b8a-4fa3-b8e0-114ec8ab0d9c]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:20:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:04 devstack sudo[99742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6
Sep 16 16:20:04 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:04 devstack sudo[99745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD
Sep 16 16:20:04 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:04 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a89485b0-2b56-43fe-a88b-58f7d5c48ca5 tempest-TestImageHashVerification-1308663722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6" returned: 0 in 0.418s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a89485b0-2b56-43fe-a88b-58f7d5c48ca5 tempest-TestImageHashVerification-1308663722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6 /opt/stack/data/cinder/conversion/52e47864-5a28-422d-82cc-0b2ac645ccc6.temp_image.21d9af2b-f661-459d-8f03-f8a3edef011aw5kgqjy2.img {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:04 devstack sudo[99752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6 /opt/stack/data/cinder/conversion/52e47864-5a28-422d-82cc-0b2ac645ccc6.temp_image.21d9af2b-f661-459d-8f03-f8a3edef011aw5kgqjy2.img
Sep 16 16:20:04 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:04 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:05 devstack sudo[99755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD
Sep 16 16:20:05 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:05 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD" returned: 1 in 0.461s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:20:05 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] 5ee9fc91-bc4e-4239-8423-26e386333333 was raw, converting to qcow2 {{(pid=86165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 16:20:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:05 devstack sudo[99770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08
Sep 16 16:20:05 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:06 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08" returned: 0 in 1.306s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:06 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5ee9fc91-bc4e-4239-8423-26e386333333_9dg_ivmydevstack@QuobyteHD, size 0.00 MB, duration 1.31 sec, destination /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08 {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:20:06 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Converted 0.00 MB image at 0.00 MB/s
Sep 16 16:20:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:06 devstack sudo[99777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08 1G
Sep 16 16:20:06 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:20:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:20:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:20:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:07 devstack sudo[99798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:20:07 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:07 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08 1G" returned: 0 in 0.784s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:07 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Downloaded image 5ee9fc91-bc4e-4239-8423-26e386333333 ((None, [{'url': 'file:///opt/stack/data/glance/images/5ee9fc91-bc4e-4239-8423-26e386333333', 'metadata': {}}])) to volume 41d694b0-14c7-4ec6-aa9e-1d0777030a08 successfully. {{(pid=86165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 16:20:07 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Temporary image 5ee9fc91-bc4e-4239-8423-26e386333333 for user d8eb2e8006934bbfaa696794d4a4ecf8 is deleted. {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 16:20:07 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Marking volume 41d694b0-14c7-4ec6-aa9e-1d0777030a08 as bootable. {{(pid=86165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 16:20:07 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Copying metadata from image 5ee9fc91-bc4e-4239-8423-26e386333333 to 41d694b0-14c7-4ec6-aa9e-1d0777030a08. {{(pid=86165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 16:20:07 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Creating volume glance metadata for volume 41d694b0-14c7-4ec6-aa9e-1d0777030a08 backed by image 5ee9fc91-bc4e-4239-8423-26e386333333 with: {'image_id': '5ee9fc91-bc4e-4239-8423-26e386333333', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '93d3b0739215cdcae9927b694f241b4c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 16:20:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b28c5b3-07ea-4ddf-b68b-da46847c9261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08', 'volume_size': 1, 'image_id': '5ee9fc91-bc4e-4239-8423-26e386333333', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ee9fc91-bc4e-4239-8423-26e386333333', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '93d3b0739215cdcae9927b694f241b4c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2f1826ca1d804c6db8f61d353f2e2ee6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14196528f3cec77a257083579f83ea78152f34b02822d84f7855f29f6d6696fa7d4cf81975a3386c3adb946b018f09d16aca1545c8df424f707a362e453cc576', 'id': '5ee9fc91-bc4e-4239-8423-26e386333333', 'created_at': datetime.datetime(2026, 9, 16, 14, 19, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 19, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ee9fc91-bc4e-4239-8423-26e386333333/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e41b9d9d0>}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039a79ec-ab98-45eb-8089-9b17a98aa9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:07 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:07 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Volume volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08 (41d694b0-14c7-4ec6-aa9e-1d0777030a08): created successfully
Sep 16 16:20:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039a79ec-ab98-45eb-8089-9b17a98aa9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Flow 'volume_create_manager' (30416adb-7858-4ab2-a6f2-2c673c266e63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:20:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.660s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:20:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:20:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 29 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:20:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>, <Thread(tpool_thread_0, started daemon 135438770624192)>, <Thread(tpool_thread_1, started daemon 135438762231488)>, <Thread(tpool_thread_2, started daemon 135438753838784)>, <Thread(tpool_thread_3, started daemon 135438745446080)>, <Thread(tpool_thread_4, started daemon 135438737053376)>, <Thread(tpool_thread_5, started daemon 135438728660672)>, <Thread(tpool_thread_6, started daemon 135438720267968)>, <Thread(tpool_thread_7, started daemon 135438711875264)>, <Thread(tpool_thread_8, started daemon 135438703466176)>, <Thread(tpool_thread_9, started daemon 135438695057088)>, <Thread(tpool_thread_10, started daemon 135438686648000)>, <Thread(tpool_thread_11, started daemon 135438678238912)>, <Thread(tpool_thread_12, started daemon 135438669829824)>, <Thread(tpool_thread_13, started daemon 135438661420736)>, <Thread(tpool_thread_14, started daemon 135438653011648)>, <Thread(tpool_thread_15, started daemon 135438644602560)>, <Thread(tpool_thread_16, started daemon 135438636193472)>, <Thread(tpool_thread_17, started daemon 135438627784384)>, <Thread(tpool_thread_18, started daemon 135438619375296)>, <Thread(tpool_thread_19, started daemon 135438610966208)>, <Thread(Rabbit-heartbeat, started daemon 135438772197760)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:20:07 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-1c6205df-04c5-4fae-86e6-09cbaaab6cd3 tempest-VolumeImageDependencyTests-392668268 None] Created volume successfully.
Sep 16 16:20:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-718fd666-d5ef-4f3f-88ea-752da1fe9948 tempest-VolumeImageDependencyTests-392668268 None] Acquiring lock "cinder-41d694b0-14c7-4ec6-aa9e-1d0777030a08-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:20:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-718fd666-d5ef-4f3f-88ea-752da1fe9948 tempest-VolumeImageDependencyTests-392668268 None] Lock "cinder-41d694b0-14c7-4ec6-aa9e-1d0777030a08-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:20:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-718fd666-d5ef-4f3f-88ea-752da1fe9948 tempest-VolumeImageDependencyTests-392668268 None] Acquiring lock "cinder-quobyte-41d694b0-14c7-4ec6-aa9e-1d0777030a08" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:20:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-718fd666-d5ef-4f3f-88ea-752da1fe9948 tempest-VolumeImageDependencyTests-392668268 None] Lock "cinder-quobyte-41d694b0-14c7-4ec6-aa9e-1d0777030a08" acquired by "delete_volume" :: waited 0.021s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:20:09 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca19db4-101e-465e-8a41-77a118279d53]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:20:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-718fd666-d5ef-4f3f-88ea-752da1fe9948 tempest-VolumeImageDependencyTests-392668268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:09 devstack sudo[99803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08
Sep 16 16:20:09 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:10 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-718fd666-d5ef-4f3f-88ea-752da1fe9948 tempest-VolumeImageDependencyTests-392668268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08" returned: 0 in 0.719s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-718fd666-d5ef-4f3f-88ea-752da1fe9948 tempest-VolumeImageDependencyTests-392668268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:10 devstack sudo[99808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08
Sep 16 16:20:10 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:10 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-718fd666-d5ef-4f3f-88ea-752da1fe9948 tempest-VolumeImageDependencyTests-392668268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-41d694b0-14c7-4ec6-aa9e-1d0777030a08" returned: 0 in 0.360s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:10 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-718fd666-d5ef-4f3f-88ea-752da1fe9948 tempest-VolumeImageDependencyTests-392668268 None] Lock "cinder-quobyte-41d694b0-14c7-4ec6-aa9e-1d0777030a08" released by "delete_volume" :: held 1.151s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:20:10 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-718fd666-d5ef-4f3f-88ea-752da1fe9948 tempest-VolumeImageDependencyTests-392668268 None] Created reservations ['99887323-eee2-4db6-b185-f82fec3077f5', '17a375d1-e726-448c-b13c-0396243558cb', 'f2932f18-73c5-4fb2-bcae-1813d3e94ce8', 'e73a111c-d11a-4073-806c-cb44c0ff1063'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:20:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-718fd666-d5ef-4f3f-88ea-752da1fe9948 tempest-VolumeImageDependencyTests-392668268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-718fd666-d5ef-4f3f-88ea-752da1fe9948 tempest-VolumeImageDependencyTests-392668268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-718fd666-d5ef-4f3f-88ea-752da1fe9948 tempest-VolumeImageDependencyTests-392668268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:20:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-718fd666-d5ef-4f3f-88ea-752da1fe9948 tempest-VolumeImageDependencyTests-392668268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:20:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-718fd666-d5ef-4f3f-88ea-752da1fe9948 tempest-VolumeImageDependencyTests-392668268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-718fd666-d5ef-4f3f-88ea-752da1fe9948 tempest-VolumeImageDependencyTests-392668268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:10 devstack sudo[99812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:20:10 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:10 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-718fd666-d5ef-4f3f-88ea-752da1fe9948 tempest-VolumeImageDependencyTests-392668268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.370s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:11 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-718fd666-d5ef-4f3f-88ea-752da1fe9948 tempest-VolumeImageDependencyTests-392668268 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:20:11 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-718fd666-d5ef-4f3f-88ea-752da1fe9948 tempest-VolumeImageDependencyTests-392668268 None] Deleted volume successfully.
Sep 16 16:20:11 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-718fd666-d5ef-4f3f-88ea-752da1fe9948 tempest-VolumeImageDependencyTests-392668268 None] Lock "cinder-41d694b0-14c7-4ec6-aa9e-1d0777030a08-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:20:11 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a89485b0-2b56-43fe-a88b-58f7d5c48ca5 tempest-TestImageHashVerification-1308663722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6 /opt/stack/data/cinder/conversion/52e47864-5a28-422d-82cc-0b2ac645ccc6.temp_image.21d9af2b-f661-459d-8f03-f8a3edef011aw5kgqjy2.img" returned: 0 in 6.534s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:11 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[954aa46a-0ec6-40ca-98c8-59b3e951e956]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:20:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a89485b0-2b56-43fe-a88b-58f7d5c48ca5 tempest-TestImageHashVerification-1308663722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:11 devstack sudo[99815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6
Sep 16 16:20:11 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:11 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a89485b0-2b56-43fe-a88b-58f7d5c48ca5 tempest-TestImageHashVerification-1308663722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6" returned: 0 in 0.530s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:11 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-a89485b0-2b56-43fe-a88b-58f7d5c48ca5 tempest-TestImageHashVerification-1308663722 None] Image conversion details: src /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/conversion/52e47864-5a28-422d-82cc-0b2ac645ccc6.temp_image.21d9af2b-f661-459d-8f03-f8a3edef011aw5kgqjy2.img {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:20:11 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-a89485b0-2b56-43fe-a88b-58f7d5c48ca5 tempest-TestImageHashVerification-1308663722 None] Converted 1024.00 MB image at 156.70 MB/s
Sep 16 16:20:11 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-a89485b0-2b56-43fe-a88b-58f7d5c48ca5 tempest-TestImageHashVerification-1308663722 None] 21d9af2b-f661-459d-8f03-f8a3edef011a was raw, no need to convert to raw {{(pid=86165) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 16 16:20:15 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:20:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Flow 'volume_create_manager' (83273296-9feb-4d13-9662-4a5f7f8c608e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:20:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861e7efd-02b1-4d49-b5f4-9380fff94009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861e7efd-02b1-4d49-b5f4-9380fff94009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1147595574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148f50d4eca34ae78209d88a2a40f80b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:16Z,use_quota=True,user_id='70e100b38fd54e559c5c892df67cf022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137bb70f-4cc4-4206-b42a-3bc0a989f34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137bb70f-4cc4-4206-b42a-3bc0a989f34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0daf6647-5ad4-4a30-85ec-5a1933116340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0daf6647-5ad4-4a30-85ec-5a1933116340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76', 'volume_name': 'volume-9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b6e9fe-2134-48f1-bbfd-96eb754bc7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b6e9fe-2134-48f1-bbfd-96eb754bc7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f4971a-f094-446e-bdb4-e0f3a30675ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:16 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Volume 9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76', 'volume_size': 1}
Sep 16 16:20:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:19 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:20:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Flow 'volume_create_manager' (6665c324-9660-422f-903c-2326f79618a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:20:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46104356-f7e6-4bbc-a039-28279d21dffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46104356-f7e6-4bbc-a039-28279d21dffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1607599635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31bfd240-014a-4be1-afbd-bb3357b1fda3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228052aae74d48618ef82bc2ad1c5439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:20Z,use_quota=True,user_id='5f8584f68ab64336866b6fb822a42f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f170aeb5-856a-4dc8-9d3d-f7938a62a139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f170aeb5-856a-4dc8-9d3d-f7938a62a139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7ec57e-c632-4344-9d52-7deeb22c0d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7ec57e-c632-4344-9d52-7deeb22c0d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31bfd240-014a-4be1-afbd-bb3357b1fda3', 'volume_name': 'volume-31bfd240-014a-4be1-afbd-bb3357b1fda3', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a246f3ad-1a54-4843-93a9-06d31b0dae34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a246f3ad-1a54-4843-93a9-06d31b0dae34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39f4595-9d90-4de5-8625-7aef04f1b4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:19 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Volume 31bfd240-014a-4be1-afbd-bb3357b1fda3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31bfd240-014a-4be1-afbd-bb3357b1fda3', 'volume_size': 1}
Sep 16 16:20:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:29 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=14,cinder:SELECT=13,cinder:INSERT=12,cinder:DELETE=2 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:20:29 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=23,cinder:UPDATE=19,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a89485b0-2b56-43fe-a88b-58f7d5c48ca5 tempest-TestImageHashVerification-1308663722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.125s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a89485b0-2b56-43fe-a88b-58f7d5c48ca5 tempest-TestImageHashVerification-1308663722 None] Uploaded volume to glance image-id: 21d9af2b-f661-459d-8f03-f8a3edef011a. {{(pid=86165) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.088s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1147595574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148f50d4eca34ae78209d88a2a40f80b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:16Z,use_quota=True,user_id='70e100b38fd54e559c5c892df67cf022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Creating volume 9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:20:32 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:32 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-a89485b0-2b56-43fe-a88b-58f7d5c48ca5 tempest-TestImageHashVerification-1308663722 None] Copy volume to image completed successfully.
Sep 16 16:20:32 devstack sudo[99831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76 1073741824
Sep 16 16:20:32 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:32 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76 1073741824" returned: 0 in 0.447s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:32 devstack sudo[99836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76
Sep 16 16:20:32 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:32 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76" returned: 0 in 0.265s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.145s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1607599635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31bfd240-014a-4be1-afbd-bb3357b1fda3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228052aae74d48618ef82bc2ad1c5439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:20Z,use_quota=True,user_id='5f8584f68ab64336866b6fb822a42f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Creating volume 31bfd240-014a-4be1-afbd-bb3357b1fda3 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:20:32 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-31bfd240-014a-4be1-afbd-bb3357b1fda3 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f4971a-f094-446e-bdb4-e0f3a30675ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:32 devstack sudo[99839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-31bfd240-014a-4be1-afbd-bb3357b1fda3 1073741824
Sep 16 16:20:32 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716683a9-60c3-4f2b-a62f-4f1a4b5c0f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:32 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Volume volume-9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76 (9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76): created successfully
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716683a9-60c3-4f2b-a62f-4f1a4b5c0f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Flow 'volume_create_manager' (83273296-9feb-4d13-9662-4a5f7f8c608e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:20:32 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-11109006-72e2-49dd-bb4e-ad43352edd00 tempest-ProjectReaderTests-406513189 None] Created volume successfully.
Sep 16 16:20:33 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-31bfd240-014a-4be1-afbd-bb3357b1fda3 1073741824" returned: 0 in 0.492s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-31bfd240-014a-4be1-afbd-bb3357b1fda3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:33 devstack sudo[99845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-31bfd240-014a-4be1-afbd-bb3357b1fda3
Sep 16 16:20:33 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1e72e8d6-6f53-4402-b660-755339cd549d tempest-TestImageHashVerification-1308663722 None] Acquiring lock "cinder-52e47864-5a28-422d-82cc-0b2ac645ccc6-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:20:33 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-31bfd240-014a-4be1-afbd-bb3357b1fda3" returned: 0 in 0.292s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:20:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1e72e8d6-6f53-4402-b660-755339cd549d tempest-TestImageHashVerification-1308663722 None] Lock "cinder-52e47864-5a28-422d-82cc-0b2ac645ccc6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:20:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39f4595-9d90-4de5-8625-7aef04f1b4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31bfd240-014a-4be1-afbd-bb3357b1fda3', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf2774c-0dc7-463e-bb96-11a86e4138e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:33 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Volume volume-31bfd240-014a-4be1-afbd-bb3357b1fda3 (31bfd240-014a-4be1-afbd-bb3357b1fda3): created successfully
Sep 16 16:20:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf2774c-0dc7-463e-bb96-11a86e4138e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Flow 'volume_create_manager' (6665c324-9660-422f-903c-2326f79618a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:20:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1e72e8d6-6f53-4402-b660-755339cd549d tempest-TestImageHashVerification-1308663722 None] Acquiring lock "cinder-quobyte-52e47864-5a28-422d-82cc-0b2ac645ccc6" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:20:33 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-3eb44226-32bd-491a-aa32-b14d7bfe226d tempest-AttachVolumeNegativeTest-909556830 None] Created volume successfully.
Sep 16 16:20:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1e72e8d6-6f53-4402-b660-755339cd549d tempest-TestImageHashVerification-1308663722 None] Lock "cinder-quobyte-52e47864-5a28-422d-82cc-0b2ac645ccc6" acquired by "delete_volume" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:20:33 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4d4efe-d976-4e22-ab98-96a2784f8a1c]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:20:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e72e8d6-6f53-4402-b660-755339cd549d tempest-TestImageHashVerification-1308663722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:33 devstack sudo[99848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6
Sep 16 16:20:33 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5b1a7b06-af80-44c8-a530-ced5fb72d96d tempest-ProjectReaderTests-406513189 None] Acquiring lock "cinder-9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:20:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5b1a7b06-af80-44c8-a530-ced5fb72d96d tempest-ProjectReaderTests-406513189 None] Lock "cinder-9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:20:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5b1a7b06-af80-44c8-a530-ced5fb72d96d tempest-ProjectReaderTests-406513189 None] Acquiring lock "cinder-quobyte-9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:20:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5b1a7b06-af80-44c8-a530-ced5fb72d96d tempest-ProjectReaderTests-406513189 None] Lock "cinder-quobyte-9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76" acquired by "delete_volume" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:20:34 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e72e8d6-6f53-4402-b660-755339cd549d tempest-TestImageHashVerification-1308663722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6" returned: 0 in 0.424s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e72e8d6-6f53-4402-b660-755339cd549d tempest-TestImageHashVerification-1308663722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:34 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2deb4527-966b-4052-a620-664bc53448cf]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:20:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5b1a7b06-af80-44c8-a530-ced5fb72d96d tempest-ProjectReaderTests-406513189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:34 devstack sudo[99853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6
Sep 16 16:20:34 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:34 devstack sudo[99854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76
Sep 16 16:20:34 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:34 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e72e8d6-6f53-4402-b660-755339cd549d tempest-TestImageHashVerification-1308663722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-52e47864-5a28-422d-82cc-0b2ac645ccc6" returned: 0 in 0.285s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1e72e8d6-6f53-4402-b660-755339cd549d tempest-TestImageHashVerification-1308663722 None] Lock "cinder-quobyte-52e47864-5a28-422d-82cc-0b2ac645ccc6" released by "delete_volume" :: held 0.753s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:20:34 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-1e72e8d6-6f53-4402-b660-755339cd549d tempest-TestImageHashVerification-1308663722 None] Created reservations ['756908cb-48ab-4a1a-a537-89128b09fa13', '37f99ca9-ddbb-449a-9172-f1a375d4a23e', '80954e60-f85b-4476-91c8-a80e324e7789', '60a8cff8-871a-4171-b94e-25e8ada3cbb6'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:20:34 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5b1a7b06-af80-44c8-a530-ced5fb72d96d tempest-ProjectReaderTests-406513189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76" returned: 0 in 0.422s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5b1a7b06-af80-44c8-a530-ced5fb72d96d tempest-ProjectReaderTests-406513189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:34 devstack sudo[99863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76
Sep 16 16:20:34 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1e72e8d6-6f53-4402-b660-755339cd549d tempest-TestImageHashVerification-1308663722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1e72e8d6-6f53-4402-b660-755339cd549d tempest-TestImageHashVerification-1308663722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1e72e8d6-6f53-4402-b660-755339cd549d tempest-TestImageHashVerification-1308663722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:20:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1e72e8d6-6f53-4402-b660-755339cd549d tempest-TestImageHashVerification-1308663722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:20:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1e72e8d6-6f53-4402-b660-755339cd549d tempest-TestImageHashVerification-1308663722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e72e8d6-6f53-4402-b660-755339cd549d tempest-TestImageHashVerification-1308663722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:34 devstack sudo[99866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:20:34 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:35 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5b1a7b06-af80-44c8-a530-ced5fb72d96d tempest-ProjectReaderTests-406513189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76" returned: 0 in 0.309s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5b1a7b06-af80-44c8-a530-ced5fb72d96d tempest-ProjectReaderTests-406513189 None] Lock "cinder-quobyte-9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76" released by "delete_volume" :: held 0.779s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:20:35 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e72e8d6-6f53-4402-b660-755339cd549d tempest-TestImageHashVerification-1308663722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.312s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:35 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-1e72e8d6-6f53-4402-b660-755339cd549d tempest-TestImageHashVerification-1308663722 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:20:35 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-1e72e8d6-6f53-4402-b660-755339cd549d tempest-TestImageHashVerification-1308663722 None] Deleted volume successfully.
Sep 16 16:20:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1e72e8d6-6f53-4402-b660-755339cd549d tempest-TestImageHashVerification-1308663722 None] Lock "cinder-52e47864-5a28-422d-82cc-0b2ac645ccc6-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:20:35 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-5b1a7b06-af80-44c8-a530-ced5fb72d96d tempest-ProjectReaderTests-406513189 None] Created reservations ['59071360-a4ec-4963-95e5-09b15d419b6b', '0d06189e-2964-4be3-9286-7d4ac26566c9', '63f769bf-3171-43d1-89bd-2851197c3d5e', '54a5bb83-c5fc-453d-9687-261ad16627dc'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:20:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5b1a7b06-af80-44c8-a530-ced5fb72d96d tempest-ProjectReaderTests-406513189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5b1a7b06-af80-44c8-a530-ced5fb72d96d tempest-ProjectReaderTests-406513189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5b1a7b06-af80-44c8-a530-ced5fb72d96d tempest-ProjectReaderTests-406513189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:20:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5b1a7b06-af80-44c8-a530-ced5fb72d96d tempest-ProjectReaderTests-406513189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:20:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5b1a7b06-af80-44c8-a530-ced5fb72d96d tempest-ProjectReaderTests-406513189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5b1a7b06-af80-44c8-a530-ced5fb72d96d tempest-ProjectReaderTests-406513189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:35 devstack sudo[99870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:20:35 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:35 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5b1a7b06-af80-44c8-a530-ced5fb72d96d tempest-ProjectReaderTests-406513189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.367s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:35 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-5b1a7b06-af80-44c8-a530-ced5fb72d96d tempest-ProjectReaderTests-406513189 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:20:35 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-5b1a7b06-af80-44c8-a530-ced5fb72d96d tempest-ProjectReaderTests-406513189 None] Deleted volume successfully.
Sep 16 16:20:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5b1a7b06-af80-44c8-a530-ced5fb72d96d tempest-ProjectReaderTests-406513189 None] Lock "cinder-9139a60f-1f13-47bd-a2d1-fd8a8a8c5b76-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:20:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-496de54a-28d3-4d5c-9729-5d32dff1e507 req-632a5d56-8056-41cd-90ea-49e82ba85b4d tempest-AttachVolumeNegativeTest-909556830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-496de54a-28d3-4d5c-9729-5d32dff1e507 req-632a5d56-8056-41cd-90ea-49e82ba85b4d tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-496de54a-28d3-4d5c-9729-5d32dff1e507 req-632a5d56-8056-41cd-90ea-49e82ba85b4d tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-496de54a-28d3-4d5c-9729-5d32dff1e507 req-632a5d56-8056-41cd-90ea-49e82ba85b4d tempest-AttachVolumeNegativeTest-909556830 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-31bfd240-014a-4be1-afbd-bb3357b1fda3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a476f1b-ec95-40cd-ae4a-98bc0e883d61', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:20:35 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-496de54a-28d3-4d5c-9729-5d32dff1e507 req-632a5d56-8056-41cd-90ea-49e82ba85b4d tempest-AttachVolumeNegativeTest-909556830 None] attachment_update completed successfully.
Sep 16 16:20:35 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Flow 'volume_create_manager' (b50b9e58-b02c-460a-802a-9a067832a6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04b7c19-71df-4cb1-86d4-aa0e3493781d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04b7c19-71df-4cb1-86d4-aa0e3493781d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1044298273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45cd87a7-d1b9-450c-8207-c50b07504430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148f50d4eca34ae78209d88a2a40f80b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:36Z,use_quota=True,user_id='70e100b38fd54e559c5c892df67cf022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5331bb7d-74a1-4413-8b4a-d0112c8b6197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5331bb7d-74a1-4413-8b4a-d0112c8b6197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (553d1578-c0ea-40df-ad44-35b6cc17457a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (553d1578-c0ea-40df-ad44-35b6cc17457a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45cd87a7-d1b9-450c-8207-c50b07504430', 'volume_name': 'volume-45cd87a7-d1b9-450c-8207-c50b07504430', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6c68bd-29de-456a-9e6f-e5d73be7e5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6c68bd-29de-456a-9e6f-e5d73be7e5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ee4286-44ab-4eaa-a4f7-17c586e568f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:36 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Volume 45cd87a7-d1b9-450c-8207-c50b07504430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45cd87a7-d1b9-450c-8207-c50b07504430', 'volume_size': 1}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1044298273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45cd87a7-d1b9-450c-8207-c50b07504430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='148f50d4eca34ae78209d88a2a40f80b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:36Z,use_quota=True,user_id='70e100b38fd54e559c5c892df67cf022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Creating volume 45cd87a7-d1b9-450c-8207-c50b07504430 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:20:36 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-45cd87a7-d1b9-450c-8207-c50b07504430 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:36 devstack sudo[99905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-45cd87a7-d1b9-450c-8207-c50b07504430 1073741824
Sep 16 16:20:36 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:36 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-45cd87a7-d1b9-450c-8207-c50b07504430 1073741824" returned: 0 in 0.551s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-45cd87a7-d1b9-450c-8207-c50b07504430 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:36 devstack sudo[100301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-45cd87a7-d1b9-450c-8207-c50b07504430
Sep 16 16:20:36 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:36 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-45cd87a7-d1b9-450c-8207-c50b07504430" returned: 0 in 0.284s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:20:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ee4286-44ab-4eaa-a4f7-17c586e568f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45cd87a7-d1b9-450c-8207-c50b07504430', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0428eb88-3ea7-4925-91bd-b1bdc02a75ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:37 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Volume volume-45cd87a7-d1b9-450c-8207-c50b07504430 (45cd87a7-d1b9-450c-8207-c50b07504430): created successfully
Sep 16 16:20:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0428eb88-3ea7-4925-91bd-b1bdc02a75ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Flow 'volume_create_manager' (b50b9e58-b02c-460a-802a-9a067832a6b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:20:37 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-2c4475cc-fb59-46c7-8a09-9fc0cc671f1a tempest-ProjectReaderTests-406513189 None] Created volume successfully.
Sep 16 16:20:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-289eade0-4004-4861-b6da-ca0b8c70c027 tempest-ProjectReaderTests-406513189 None] Acquiring lock "cinder-45cd87a7-d1b9-450c-8207-c50b07504430-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:20:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-289eade0-4004-4861-b6da-ca0b8c70c027 tempest-ProjectReaderTests-406513189 None] Lock "cinder-45cd87a7-d1b9-450c-8207-c50b07504430-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:20:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-289eade0-4004-4861-b6da-ca0b8c70c027 tempest-ProjectReaderTests-406513189 None] Acquiring lock "cinder-quobyte-45cd87a7-d1b9-450c-8207-c50b07504430" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:20:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-289eade0-4004-4861-b6da-ca0b8c70c027 tempest-ProjectReaderTests-406513189 None] Lock "cinder-quobyte-45cd87a7-d1b9-450c-8207-c50b07504430" acquired by "delete_volume" :: waited 0.021s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:20:38 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[defb0959-6f89-4c89-aac8-ec912aebe2b3]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:20:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-289eade0-4004-4861-b6da-ca0b8c70c027 tempest-ProjectReaderTests-406513189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-45cd87a7-d1b9-450c-8207-c50b07504430 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:38 devstack sudo[100305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-45cd87a7-d1b9-450c-8207-c50b07504430
Sep 16 16:20:38 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:38 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-df7e71a1-681e-48bf-929b-535e4485ec30 req-77c86ab1-13cb-4564-b773-e9063a4868ee tempest-AttachVolumeNegativeTest-909556830 None] Terminate volume connection completed successfully.
Sep 16 16:20:38 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-df7e71a1-681e-48bf-929b-535e4485ec30 req-77c86ab1-13cb-4564-b773-e9063a4868ee tempest-AttachVolumeNegativeTest-909556830 None] Deleting attachment 1a476f1b-ec95-40cd-ae4a-98bc0e883d61. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:20:38 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-289eade0-4004-4861-b6da-ca0b8c70c027 tempest-ProjectReaderTests-406513189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-45cd87a7-d1b9-450c-8207-c50b07504430" returned: 0 in 0.463s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-289eade0-4004-4861-b6da-ca0b8c70c027 tempest-ProjectReaderTests-406513189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-45cd87a7-d1b9-450c-8207-c50b07504430 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:38 devstack sudo[100336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-45cd87a7-d1b9-450c-8207-c50b07504430
Sep 16 16:20:38 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:39 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-289eade0-4004-4861-b6da-ca0b8c70c027 tempest-ProjectReaderTests-406513189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-45cd87a7-d1b9-450c-8207-c50b07504430" returned: 0 in 0.412s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-289eade0-4004-4861-b6da-ca0b8c70c027 tempest-ProjectReaderTests-406513189 None] Lock "cinder-quobyte-45cd87a7-d1b9-450c-8207-c50b07504430" released by "delete_volume" :: held 0.934s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:20:39 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-289eade0-4004-4861-b6da-ca0b8c70c027 tempest-ProjectReaderTests-406513189 None] Created reservations ['94c94ae6-3584-49c3-8cb3-dbe6fc65dbf3', '79d63b92-fd7f-4aec-a0d2-e843a215b7dd', '6991612d-2243-4a2c-9f73-17c605a75e2d', 'a6ac176c-d143-43bc-8b66-e0fd21a153b7'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:20:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-289eade0-4004-4861-b6da-ca0b8c70c027 tempest-ProjectReaderTests-406513189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-289eade0-4004-4861-b6da-ca0b8c70c027 tempest-ProjectReaderTests-406513189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-289eade0-4004-4861-b6da-ca0b8c70c027 tempest-ProjectReaderTests-406513189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:20:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-289eade0-4004-4861-b6da-ca0b8c70c027 tempest-ProjectReaderTests-406513189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:20:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-289eade0-4004-4861-b6da-ca0b8c70c027 tempest-ProjectReaderTests-406513189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-289eade0-4004-4861-b6da-ca0b8c70c027 tempest-ProjectReaderTests-406513189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:39 devstack sudo[100340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:20:39 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:39 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-289eade0-4004-4861-b6da-ca0b8c70c027 tempest-ProjectReaderTests-406513189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.373s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:39 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-289eade0-4004-4861-b6da-ca0b8c70c027 tempest-ProjectReaderTests-406513189 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:20:39 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-289eade0-4004-4861-b6da-ca0b8c70c027 tempest-ProjectReaderTests-406513189 None] Deleted volume successfully.
Sep 16 16:20:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-289eade0-4004-4861-b6da-ca0b8c70c027 tempest-ProjectReaderTests-406513189 None] Lock "cinder-45cd87a7-d1b9-450c-8207-c50b07504430-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:20:50 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=25,cinder:UPDATE=34,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:20:50 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=30,cinder:UPDATE=35,cinder:DELETE=3,cinder:INSERT=7 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:20:50 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:20:50 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Flow 'volume_create_manager' (62f4b0c2-e4c8-4130-ac5f-4a22128fbd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:20:50 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb80ff4-fecd-4c89-862f-6e0b9b860626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:50 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb80ff4-fecd-4c89-862f-6e0b9b860626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1862366336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34bd3a6d-a293-40d4-84ad-462fe61eb2b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5676c2bbb56a4a9484c71ebd17fa74a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:51Z,use_quota=True,user_id='e4e0c3dba9614feaadd6a281b61afdaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:50 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ea9df4-b6f5-4fd3-a262-62fa64701a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ea9df4-b6f5-4fd3-a262-62fa64701a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4bf0a9d-542c-4381-bdfb-c5add1bfd4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4bf0a9d-542c-4381-bdfb-c5add1bfd4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34bd3a6d-a293-40d4-84ad-462fe61eb2b9', 'volume_name': 'volume-34bd3a6d-a293-40d4-84ad-462fe61eb2b9', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d6a5c4f-5600-490e-9408-295b6dc5b8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d6a5c4f-5600-490e-9408-295b6dc5b8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7318606c-41d6-415a-b3b5-5ef3ec6eb5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:51 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Volume 34bd3a6d-a293-40d4-84ad-462fe61eb2b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34bd3a6d-a293-40d4-84ad-462fe61eb2b9', 'volume_size': 1}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1862366336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34bd3a6d-a293-40d4-84ad-462fe61eb2b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5676c2bbb56a4a9484c71ebd17fa74a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:51Z,use_quota=True,user_id='e4e0c3dba9614feaadd6a281b61afdaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Creating volume 34bd3a6d-a293-40d4-84ad-462fe61eb2b9 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:20:51 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-34bd3a6d-a293-40d4-84ad-462fe61eb2b9 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:51 devstack sudo[100377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-34bd3a6d-a293-40d4-84ad-462fe61eb2b9 1073741824
Sep 16 16:20:51 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Flow 'volume_create_manager' (0cd39092-a236-48e5-8bb4-f3f15c1b5cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f48d93-e364-42ff-ad42-2da72f2a0fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f48d93-e364-42ff-ad42-2da72f2a0fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1243219392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f744614-9c0a-4f03-820d-ac5f33a987f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5676c2bbb56a4a9484c71ebd17fa74a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:51Z,use_quota=True,user_id='e4e0c3dba9614feaadd6a281b61afdaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74bb15a4-752b-4a5b-a88e-06e915c6e123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74bb15a4-752b-4a5b-a88e-06e915c6e123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73f15d4-d6e6-43c1-8f4d-07d7a0f53c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73f15d4-d6e6-43c1-8f4d-07d7a0f53c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f744614-9c0a-4f03-820d-ac5f33a987f0', 'volume_name': 'volume-6f744614-9c0a-4f03-820d-ac5f33a987f0', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb49cff-61bb-4825-b175-88c862812657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb49cff-61bb-4825-b175-88c862812657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10667ec9-8e47-491e-9ccc-ff1bbdc5b728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:51 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Volume 6f744614-9c0a-4f03-820d-ac5f33a987f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f744614-9c0a-4f03-820d-ac5f33a987f0', 'volume_size': 1}
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:51 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-34bd3a6d-a293-40d4-84ad-462fe61eb2b9 1073741824" returned: 0 in 0.871s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-34bd3a6d-a293-40d4-84ad-462fe61eb2b9 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:52 devstack sudo[100397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-34bd3a6d-a293-40d4-84ad-462fe61eb2b9
Sep 16 16:20:52 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Flow 'volume_create_manager' (bd154a2c-ad15-4be2-9c4c-914150d261da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a5873d-22a1-4e29-906c-a8637fcb4a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a5873d-22a1-4e29-906c-a8637fcb4a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1428349570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f3b5c0-4c34-4ac9-8285-4be20799c5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5676c2bbb56a4a9484c71ebd17fa74a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:52Z,use_quota=True,user_id='e4e0c3dba9614feaadd6a281b61afdaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80be07d6-170b-4f21-86ca-0c95d49a0933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80be07d6-170b-4f21-86ca-0c95d49a0933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1620cca4-5a14-43ef-98ea-cced08be673b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1620cca4-5a14-43ef-98ea-cced08be673b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9f3b5c0-4c34-4ac9-8285-4be20799c5c3', 'volume_name': 'volume-a9f3b5c0-4c34-4ac9-8285-4be20799c5c3', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c37661-387f-4647-bea4-0e619edf3e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c37661-387f-4647-bea4-0e619edf3e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb235c5f-e2b5-470d-9e02-58b4b5f2d71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:52 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Volume a9f3b5c0-4c34-4ac9-8285-4be20799c5c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9f3b5c0-4c34-4ac9-8285-4be20799c5c3', 'volume_size': 1}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:52 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-34bd3a6d-a293-40d4-84ad-462fe61eb2b9" returned: 0 in 0.606s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.067s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1243219392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f744614-9c0a-4f03-820d-ac5f33a987f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5676c2bbb56a4a9484c71ebd17fa74a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:51Z,use_quota=True,user_id='e4e0c3dba9614feaadd6a281b61afdaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Creating volume 6f744614-9c0a-4f03-820d-ac5f33a987f0 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:20:52 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f744614-9c0a-4f03-820d-ac5f33a987f0 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:52 devstack sudo[100403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f744614-9c0a-4f03-820d-ac5f33a987f0 1073741824
Sep 16 16:20:52 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7318606c-41d6-415a-b3b5-5ef3ec6eb5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34bd3a6d-a293-40d4-84ad-462fe61eb2b9', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7271fab-d98c-4f40-b7a0-68710b325391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:52 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Volume volume-34bd3a6d-a293-40d4-84ad-462fe61eb2b9 (34bd3a6d-a293-40d4-84ad-462fe61eb2b9): created successfully
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7271fab-d98c-4f40-b7a0-68710b325391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Flow 'volume_create_manager' (62f4b0c2-e4c8-4130-ac5f-4a22128fbd2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:20:52 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-0659b157-5e9f-47b2-bb75-ff0ef37d62bd tempest-CreateVolumesFromImageTest-484182616 None] Created volume successfully.
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Flow 'volume_create_manager' (e40274de-40bb-42be-b8d8-d6cdcdd0ce5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:20:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55950a5c-0b50-42ef-b21f-065b011da74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55950a5c-0b50-42ef-b21f-065b011da74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1282538257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f551faab-4e1c-4932-9ece-f232243a102f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5676c2bbb56a4a9484c71ebd17fa74a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:53Z,use_quota=True,user_id='e4e0c3dba9614feaadd6a281b61afdaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de12129-0876-47ff-832d-fef6f3ec8490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de12129-0876-47ff-832d-fef6f3ec8490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1699fe0a-11b0-4205-b753-8fcbc7420b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1699fe0a-11b0-4205-b753-8fcbc7420b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f551faab-4e1c-4932-9ece-f232243a102f', 'volume_name': 'volume-f551faab-4e1c-4932-9ece-f232243a102f', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59598e2d-b845-4685-a1e3-1481455cf667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59598e2d-b845-4685-a1e3-1481455cf667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5d4129-4e80-4d24-8fb3-e9553e86c0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:53 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Volume f551faab-4e1c-4932-9ece-f232243a102f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f551faab-4e1c-4932-9ece-f232243a102f', 'volume_size': 1}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:53 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f744614-9c0a-4f03-820d-ac5f33a987f0 1073741824" returned: 0 in 0.744s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f744614-9c0a-4f03-820d-ac5f33a987f0 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:53 devstack sudo[100409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f744614-9c0a-4f03-820d-ac5f33a987f0
Sep 16 16:20:53 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Flow 'volume_create_manager' (ed0be06e-55d5-4622-8616-82da413542a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5af058-c078-4440-aa8c-8c20ce153749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5af058-c078-4440-aa8c-8c20ce153749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-293169452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d32051e-deda-4a9b-b4c3-a42a843350a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5676c2bbb56a4a9484c71ebd17fa74a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:53Z,use_quota=True,user_id='e4e0c3dba9614feaadd6a281b61afdaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acaa89b3-8118-498d-88aa-11c4b2d3882f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acaa89b3-8118-498d-88aa-11c4b2d3882f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8980e2db-027b-4fb1-b131-d5dfb148f567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8980e2db-027b-4fb1-b131-d5dfb148f567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d32051e-deda-4a9b-b4c3-a42a843350a4', 'volume_name': 'volume-2d32051e-deda-4a9b-b4c3-a42a843350a4', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ca583b-40d5-4208-ad57-c3463c0787f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ca583b-40d5-4208-ad57-c3463c0787f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78320df8-d7f3-4bca-b540-80ce473201b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:53 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Volume 2d32051e-deda-4a9b-b4c3-a42a843350a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d32051e-deda-4a9b-b4c3-a42a843350a4', 'volume_size': 1}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:53 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f744614-9c0a-4f03-820d-ac5f33a987f0" returned: 0 in 0.344s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.577s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1428349570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f3b5c0-4c34-4ac9-8285-4be20799c5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5676c2bbb56a4a9484c71ebd17fa74a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:52Z,use_quota=True,user_id='e4e0c3dba9614feaadd6a281b61afdaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Creating volume a9f3b5c0-4c34-4ac9-8285-4be20799c5c3 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:20:53 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a9f3b5c0-4c34-4ac9-8285-4be20799c5c3 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:53 devstack sudo[100412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a9f3b5c0-4c34-4ac9-8285-4be20799c5c3 1073741824
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10667ec9-8e47-491e-9ccc-ff1bbdc5b728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f744614-9c0a-4f03-820d-ac5f33a987f0', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:53 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a69bc92-1124-460d-92db-fbb9f4537e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:53 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Volume volume-6f744614-9c0a-4f03-820d-ac5f33a987f0 (6f744614-9c0a-4f03-820d-ac5f33a987f0): created successfully
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a69bc92-1124-460d-92db-fbb9f4537e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Flow 'volume_create_manager' (0cd39092-a236-48e5-8bb4-f3f15c1b5cfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:20:53 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-8f346e7f-7203-4c7d-a49a-912cfdcbf28b tempest-CreateVolumesFromImageTest-484182616 None] Created volume successfully.
Sep 16 16:20:54 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a9f3b5c0-4c34-4ac9-8285-4be20799c5c3 1073741824" returned: 0 in 0.658s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a9f3b5c0-4c34-4ac9-8285-4be20799c5c3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:54 devstack sudo[100419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a9f3b5c0-4c34-4ac9-8285-4be20799c5c3
Sep 16 16:20:54 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:54 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a9f3b5c0-4c34-4ac9-8285-4be20799c5c3" returned: 0 in 0.311s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:20:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.804s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1282538257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f551faab-4e1c-4932-9ece-f232243a102f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5676c2bbb56a4a9484c71ebd17fa74a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:53Z,use_quota=True,user_id='e4e0c3dba9614feaadd6a281b61afdaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:20:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Creating volume f551faab-4e1c-4932-9ece-f232243a102f {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:20:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:20:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:20:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:20:54 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:20:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f551faab-4e1c-4932-9ece-f232243a102f 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb235c5f-e2b5-470d-9e02-58b4b5f2d71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9f3b5c0-4c34-4ac9-8285-4be20799c5c3', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:54 devstack sudo[100422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f551faab-4e1c-4932-9ece-f232243a102f 1073741824
Sep 16 16:20:54 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4383f5a3-adf7-45b2-8dfa-3024f32a0e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:54 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Volume volume-a9f3b5c0-4c34-4ac9-8285-4be20799c5c3 (a9f3b5c0-4c34-4ac9-8285-4be20799c5c3): created successfully
Sep 16 16:20:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4383f5a3-adf7-45b2-8dfa-3024f32a0e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Flow 'volume_create_manager' (bd154a2c-ad15-4be2-9c4c-914150d261da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:20:54 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-ab4b5a53-0c82-4fdf-b0c2-6f1269584ff6 tempest-CreateVolumesFromImageTest-484182616 None] Created volume successfully.
Sep 16 16:20:55 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f551faab-4e1c-4932-9ece-f232243a102f 1073741824" returned: 0 in 0.753s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f551faab-4e1c-4932-9ece-f232243a102f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:55 devstack sudo[100480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f551faab-4e1c-4932-9ece-f232243a102f
Sep 16 16:20:55 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:56 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f551faab-4e1c-4932-9ece-f232243a102f" returned: 0 in 0.330s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:20:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.361s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-293169452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d32051e-deda-4a9b-b4c3-a42a843350a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5676c2bbb56a4a9484c71ebd17fa74a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:53Z,use_quota=True,user_id='e4e0c3dba9614feaadd6a281b61afdaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:20:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Creating volume 2d32051e-deda-4a9b-b4c3-a42a843350a4 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:20:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:20:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:20:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:20:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:20:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:20:56 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:20:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d32051e-deda-4a9b-b4c3-a42a843350a4 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5d4129-4e80-4d24-8fb3-e9553e86c0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f551faab-4e1c-4932-9ece-f232243a102f', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c75880b-34e0-4e46-958e-390b9b712240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:56 devstack sudo[100492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d32051e-deda-4a9b-b4c3-a42a843350a4 1073741824
Sep 16 16:20:56 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:56 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Volume volume-f551faab-4e1c-4932-9ece-f232243a102f (f551faab-4e1c-4932-9ece-f232243a102f): created successfully
Sep 16 16:20:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c75880b-34e0-4e46-958e-390b9b712240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Flow 'volume_create_manager' (e40274de-40bb-42be-b8d8-d6cdcdd0ce5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:20:56 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-2b5feb75-af6f-47db-a096-ba1efa140064 tempest-CreateVolumesFromImageTest-484182616 None] Created volume successfully.
Sep 16 16:20:57 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d32051e-deda-4a9b-b4c3-a42a843350a4 1073741824" returned: 0 in 0.943s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d32051e-deda-4a9b-b4c3-a42a843350a4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:57 devstack sudo[100505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d32051e-deda-4a9b-b4c3-a42a843350a4
Sep 16 16:20:57 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:57 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d32051e-deda-4a9b-b4c3-a42a843350a4" returned: 0 in 0.425s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:57 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:20:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:20:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78320df8-d7f3-4bca-b540-80ce473201b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d32051e-deda-4a9b-b4c3-a42a843350a4', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b10edb-8180-4225-a692-0602802f4f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:20:57 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Volume volume-2d32051e-deda-4a9b-b4c3-a42a843350a4 (2d32051e-deda-4a9b-b4c3-a42a843350a4): created successfully
Sep 16 16:20:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b10edb-8180-4225-a692-0602802f4f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:20:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Flow 'volume_create_manager' (ed0be06e-55d5-4622-8616-82da413542a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:20:57 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-2df53e29-a4ac-4431-b1bd-e10c401688a6 tempest-CreateVolumesFromImageTest-484182616 None] Created volume successfully.
Sep 16 16:20:58 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f4386b48-2296-406e-8d26-d73cddd7198e tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "cinder-2d32051e-deda-4a9b-b4c3-a42a843350a4-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:20:58 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f4386b48-2296-406e-8d26-d73cddd7198e tempest-CreateVolumesFromImageTest-484182616 None] Lock "cinder-2d32051e-deda-4a9b-b4c3-a42a843350a4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:20:58 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f4386b48-2296-406e-8d26-d73cddd7198e tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "cinder-quobyte-2d32051e-deda-4a9b-b4c3-a42a843350a4" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:20:58 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f4386b48-2296-406e-8d26-d73cddd7198e tempest-CreateVolumesFromImageTest-484182616 None] Lock "cinder-quobyte-2d32051e-deda-4a9b-b4c3-a42a843350a4" acquired by "delete_volume" :: waited 0.033s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:20:58 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7afa31-645f-4152-9444-ed6803b6b48a]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:20:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f4386b48-2296-406e-8d26-d73cddd7198e tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d32051e-deda-4a9b-b4c3-a42a843350a4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:58 devstack sudo[100508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d32051e-deda-4a9b-b4c3-a42a843350a4
Sep 16 16:20:58 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:59 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f4386b48-2296-406e-8d26-d73cddd7198e tempest-CreateVolumesFromImageTest-484182616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d32051e-deda-4a9b-b4c3-a42a843350a4" returned: 0 in 0.656s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f4386b48-2296-406e-8d26-d73cddd7198e tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d32051e-deda-4a9b-b4c3-a42a843350a4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:20:59 devstack sudo[100514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d32051e-deda-4a9b-b4c3-a42a843350a4
Sep 16 16:20:59 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:20:59 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root
Sep 16 16:20:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f4386b48-2296-406e-8d26-d73cddd7198e tempest-CreateVolumesFromImageTest-484182616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d32051e-deda-4a9b-b4c3-a42a843350a4" returned: 0 in 0.433s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:20:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f4386b48-2296-406e-8d26-d73cddd7198e tempest-CreateVolumesFromImageTest-484182616 None] Lock "cinder-quobyte-2d32051e-deda-4a9b-b4c3-a42a843350a4" released by "delete_volume" :: held 1.187s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:20:59 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-f4386b48-2296-406e-8d26-d73cddd7198e tempest-CreateVolumesFromImageTest-484182616 None] Created reservations ['a69f6fdb-ef2b-496d-a0b2-f3cd81534654', '61f33f63-efad-46e7-a938-90a07ac1a4c5', 'f65f45d5-8a42-47d2-a60b-7422183455c8', '42c6aa97-38fc-4991-a328-4286fbfcf198'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:21:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f4386b48-2296-406e-8d26-d73cddd7198e tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f4386b48-2296-406e-8d26-d73cddd7198e tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-f4386b48-2296-406e-8d26-d73cddd7198e tempest-CreateVolumesFromImageTest-484182616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-f4386b48-2296-406e-8d26-d73cddd7198e tempest-CreateVolumesFromImageTest-484182616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f4386b48-2296-406e-8d26-d73cddd7198e tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f4386b48-2296-406e-8d26-d73cddd7198e tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:00 devstack sudo[100518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:21:00 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:00 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f4386b48-2296-406e-8d26-d73cddd7198e tempest-CreateVolumesFromImageTest-484182616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.493s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:00 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-f4386b48-2296-406e-8d26-d73cddd7198e tempest-CreateVolumesFromImageTest-484182616 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:21:00 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-f4386b48-2296-406e-8d26-d73cddd7198e tempest-CreateVolumesFromImageTest-484182616 None] Deleted volume successfully.
Sep 16 16:21:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f4386b48-2296-406e-8d26-d73cddd7198e tempest-CreateVolumesFromImageTest-484182616 None] Lock "cinder-2d32051e-deda-4a9b-b4c3-a42a843350a4-delete_volume" released by "delete_volume" :: held 2.144s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f9119647-9e4b-47d3-bcd4-0a6340e160c2 tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "cinder-f551faab-4e1c-4932-9ece-f232243a102f-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f9119647-9e4b-47d3-bcd4-0a6340e160c2 tempest-CreateVolumesFromImageTest-484182616 None] Lock "cinder-f551faab-4e1c-4932-9ece-f232243a102f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f9119647-9e4b-47d3-bcd4-0a6340e160c2 tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "cinder-quobyte-f551faab-4e1c-4932-9ece-f232243a102f" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f9119647-9e4b-47d3-bcd4-0a6340e160c2 tempest-CreateVolumesFromImageTest-484182616 None] Lock "cinder-quobyte-f551faab-4e1c-4932-9ece-f232243a102f" acquired by "delete_volume" :: waited 0.015s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:00 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2a346e-5535-4a7e-a5fe-418ff2bd5f89]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f9119647-9e4b-47d3-bcd4-0a6340e160c2 tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f551faab-4e1c-4932-9ece-f232243a102f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:01 devstack sudo[100522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f551faab-4e1c-4932-9ece-f232243a102f
Sep 16 16:21:01 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:01 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f9119647-9e4b-47d3-bcd4-0a6340e160c2 tempest-CreateVolumesFromImageTest-484182616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f551faab-4e1c-4932-9ece-f232243a102f" returned: 0 in 0.453s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f9119647-9e4b-47d3-bcd4-0a6340e160c2 tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f551faab-4e1c-4932-9ece-f232243a102f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:01 devstack sudo[100561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f551faab-4e1c-4932-9ece-f232243a102f
Sep 16 16:21:01 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:01 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f9119647-9e4b-47d3-bcd4-0a6340e160c2 tempest-CreateVolumesFromImageTest-484182616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f551faab-4e1c-4932-9ece-f232243a102f" returned: 0 in 0.360s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:01 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f9119647-9e4b-47d3-bcd4-0a6340e160c2 tempest-CreateVolumesFromImageTest-484182616 None] Lock "cinder-quobyte-f551faab-4e1c-4932-9ece-f232243a102f" released by "delete_volume" :: held 0.866s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:01 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-f9119647-9e4b-47d3-bcd4-0a6340e160c2 tempest-CreateVolumesFromImageTest-484182616 None] Created reservations ['cf300cec-6a82-425d-9eb5-77cdb89b094c', '16d1bbf5-1e3b-4bbf-a763-af1c11f43e54', '3cd8a5d7-92f7-4102-bb0d-b7af31862a04', '8f3a6b91-ed5b-411c-b1db-110698023a2c'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:21:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f9119647-9e4b-47d3-bcd4-0a6340e160c2 tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f9119647-9e4b-47d3-bcd4-0a6340e160c2 tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:01 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-f9119647-9e4b-47d3-bcd4-0a6340e160c2 tempest-CreateVolumesFromImageTest-484182616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:01 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-f9119647-9e4b-47d3-bcd4-0a6340e160c2 tempest-CreateVolumesFromImageTest-484182616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f9119647-9e4b-47d3-bcd4-0a6340e160c2 tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f9119647-9e4b-47d3-bcd4-0a6340e160c2 tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:01 devstack sudo[100566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:21:01 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6f6594c2-e3dc-4764-a939-cf09ff7df8bd tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "cinder-a9f3b5c0-4c34-4ac9-8285-4be20799c5c3-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6f6594c2-e3dc-4764-a939-cf09ff7df8bd tempest-CreateVolumesFromImageTest-484182616 None] Lock "cinder-a9f3b5c0-4c34-4ac9-8285-4be20799c5c3-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6f6594c2-e3dc-4764-a939-cf09ff7df8bd tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "cinder-quobyte-a9f3b5c0-4c34-4ac9-8285-4be20799c5c3" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6f6594c2-e3dc-4764-a939-cf09ff7df8bd tempest-CreateVolumesFromImageTest-484182616 None] Lock "cinder-quobyte-a9f3b5c0-4c34-4ac9-8285-4be20799c5c3" acquired by "delete_volume" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:02 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc5281d-ddda-4345-aeea-11367ee83358]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6f6594c2-e3dc-4764-a939-cf09ff7df8bd tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a9f3b5c0-4c34-4ac9-8285-4be20799c5c3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:02 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f9119647-9e4b-47d3-bcd4-0a6340e160c2 tempest-CreateVolumesFromImageTest-484182616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.348s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:02 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-f9119647-9e4b-47d3-bcd4-0a6340e160c2 tempest-CreateVolumesFromImageTest-484182616 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:21:02 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-f9119647-9e4b-47d3-bcd4-0a6340e160c2 tempest-CreateVolumesFromImageTest-484182616 None] Deleted volume successfully.
Sep 16 16:21:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f9119647-9e4b-47d3-bcd4-0a6340e160c2 tempest-CreateVolumesFromImageTest-484182616 None] Lock "cinder-f551faab-4e1c-4932-9ece-f232243a102f-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:02 devstack sudo[100568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a9f3b5c0-4c34-4ac9-8285-4be20799c5c3
Sep 16 16:21:02 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:02 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6f6594c2-e3dc-4764-a939-cf09ff7df8bd tempest-CreateVolumesFromImageTest-484182616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a9f3b5c0-4c34-4ac9-8285-4be20799c5c3" returned: 0 in 0.502s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6f6594c2-e3dc-4764-a939-cf09ff7df8bd tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a9f3b5c0-4c34-4ac9-8285-4be20799c5c3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:02 devstack sudo[100576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a9f3b5c0-4c34-4ac9-8285-4be20799c5c3
Sep 16 16:21:02 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:03 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6f6594c2-e3dc-4764-a939-cf09ff7df8bd tempest-CreateVolumesFromImageTest-484182616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a9f3b5c0-4c34-4ac9-8285-4be20799c5c3" returned: 0 in 0.323s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:03 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6f6594c2-e3dc-4764-a939-cf09ff7df8bd tempest-CreateVolumesFromImageTest-484182616 None] Lock "cinder-quobyte-a9f3b5c0-4c34-4ac9-8285-4be20799c5c3" released by "delete_volume" :: held 0.888s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:03 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-6f6594c2-e3dc-4764-a939-cf09ff7df8bd tempest-CreateVolumesFromImageTest-484182616 None] Created reservations ['604a2352-f5e3-4669-be2b-e824d8b45855', '37a6d265-4a07-4b85-8d43-45a302a31d28', '67a5b776-ca8c-493a-9f91-2088b4ef2d54', 'e5bd6ad0-f2c5-4529-a5eb-49a4442ebdd5'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:21:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6f6594c2-e3dc-4764-a939-cf09ff7df8bd tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6f6594c2-e3dc-4764-a939-cf09ff7df8bd tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:03 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6f6594c2-e3dc-4764-a939-cf09ff7df8bd tempest-CreateVolumesFromImageTest-484182616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:03 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6f6594c2-e3dc-4764-a939-cf09ff7df8bd tempest-CreateVolumesFromImageTest-484182616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6f6594c2-e3dc-4764-a939-cf09ff7df8bd tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6f6594c2-e3dc-4764-a939-cf09ff7df8bd tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:03 devstack sudo[100579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:21:03 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:03 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c67b8821-a383-44da-b6d3-2bc0091e4d8b tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "cinder-6f744614-9c0a-4f03-820d-ac5f33a987f0-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:03 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c67b8821-a383-44da-b6d3-2bc0091e4d8b tempest-CreateVolumesFromImageTest-484182616 None] Lock "cinder-6f744614-9c0a-4f03-820d-ac5f33a987f0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:03 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c67b8821-a383-44da-b6d3-2bc0091e4d8b tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "cinder-quobyte-6f744614-9c0a-4f03-820d-ac5f33a987f0" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:03 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c67b8821-a383-44da-b6d3-2bc0091e4d8b tempest-CreateVolumesFromImageTest-484182616 None] Lock "cinder-quobyte-6f744614-9c0a-4f03-820d-ac5f33a987f0" acquired by "delete_volume" :: waited 0.050s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:03 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd42bac1-67b7-4ef5-98e5-2e797b19e187]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c67b8821-a383-44da-b6d3-2bc0091e4d8b tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f744614-9c0a-4f03-820d-ac5f33a987f0 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:03 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6f6594c2-e3dc-4764-a939-cf09ff7df8bd tempest-CreateVolumesFromImageTest-484182616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.461s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:03 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-6f6594c2-e3dc-4764-a939-cf09ff7df8bd tempest-CreateVolumesFromImageTest-484182616 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:21:03 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-6f6594c2-e3dc-4764-a939-cf09ff7df8bd tempest-CreateVolumesFromImageTest-484182616 None] Deleted volume successfully.
Sep 16 16:21:03 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6f6594c2-e3dc-4764-a939-cf09ff7df8bd tempest-CreateVolumesFromImageTest-484182616 None] Lock "cinder-a9f3b5c0-4c34-4ac9-8285-4be20799c5c3-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:03 devstack sudo[100581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f744614-9c0a-4f03-820d-ac5f33a987f0
Sep 16 16:21:03 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:04 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c67b8821-a383-44da-b6d3-2bc0091e4d8b tempest-CreateVolumesFromImageTest-484182616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f744614-9c0a-4f03-820d-ac5f33a987f0" returned: 0 in 0.463s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c67b8821-a383-44da-b6d3-2bc0091e4d8b tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f744614-9c0a-4f03-820d-ac5f33a987f0 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:04 devstack sudo[100587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f744614-9c0a-4f03-820d-ac5f33a987f0
Sep 16 16:21:04 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:04 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c67b8821-a383-44da-b6d3-2bc0091e4d8b tempest-CreateVolumesFromImageTest-484182616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f744614-9c0a-4f03-820d-ac5f33a987f0" returned: 0 in 0.256s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c67b8821-a383-44da-b6d3-2bc0091e4d8b tempest-CreateVolumesFromImageTest-484182616 None] Lock "cinder-quobyte-6f744614-9c0a-4f03-820d-ac5f33a987f0" released by "delete_volume" :: held 0.810s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:04 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-c67b8821-a383-44da-b6d3-2bc0091e4d8b tempest-CreateVolumesFromImageTest-484182616 None] Created reservations ['55c23c99-c433-40ce-879c-b19a0b60d559', '4bf80e35-ac31-49f3-b11c-1e5c2ba68d7c', '396c8c6a-c5db-4c8c-bcc8-cbe54f7e4054', 'c7f36841-fbb3-4bc3-9180-32b4f94ccd29'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:21:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c67b8821-a383-44da-b6d3-2bc0091e4d8b tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c67b8821-a383-44da-b6d3-2bc0091e4d8b tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:04 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c67b8821-a383-44da-b6d3-2bc0091e4d8b tempest-CreateVolumesFromImageTest-484182616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:04 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c67b8821-a383-44da-b6d3-2bc0091e4d8b tempest-CreateVolumesFromImageTest-484182616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c67b8821-a383-44da-b6d3-2bc0091e4d8b tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c67b8821-a383-44da-b6d3-2bc0091e4d8b tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:04 devstack sudo[100590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:21:04 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e31fdeeb-0122-4bc6-8ac4-f39eb781adca tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "cinder-34bd3a6d-a293-40d4-84ad-462fe61eb2b9-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e31fdeeb-0122-4bc6-8ac4-f39eb781adca tempest-CreateVolumesFromImageTest-484182616 None] Lock "cinder-34bd3a6d-a293-40d4-84ad-462fe61eb2b9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e31fdeeb-0122-4bc6-8ac4-f39eb781adca tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "cinder-quobyte-34bd3a6d-a293-40d4-84ad-462fe61eb2b9" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e31fdeeb-0122-4bc6-8ac4-f39eb781adca tempest-CreateVolumesFromImageTest-484182616 None] Lock "cinder-quobyte-34bd3a6d-a293-40d4-84ad-462fe61eb2b9" acquired by "delete_volume" :: waited 0.024s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:04 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e836ef-d129-4abc-ae9d-fdedb23f1c28]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e31fdeeb-0122-4bc6-8ac4-f39eb781adca tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-34bd3a6d-a293-40d4-84ad-462fe61eb2b9 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:04 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c67b8821-a383-44da-b6d3-2bc0091e4d8b tempest-CreateVolumesFromImageTest-484182616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.369s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:04 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-c67b8821-a383-44da-b6d3-2bc0091e4d8b tempest-CreateVolumesFromImageTest-484182616 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:21:04 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c67b8821-a383-44da-b6d3-2bc0091e4d8b tempest-CreateVolumesFromImageTest-484182616 None] Deleted volume successfully.
Sep 16 16:21:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c67b8821-a383-44da-b6d3-2bc0091e4d8b tempest-CreateVolumesFromImageTest-484182616 None] Lock "cinder-6f744614-9c0a-4f03-820d-ac5f33a987f0-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:04 devstack sudo[100593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-34bd3a6d-a293-40d4-84ad-462fe61eb2b9
Sep 16 16:21:04 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:05 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e31fdeeb-0122-4bc6-8ac4-f39eb781adca tempest-CreateVolumesFromImageTest-484182616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-34bd3a6d-a293-40d4-84ad-462fe61eb2b9" returned: 0 in 0.410s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e31fdeeb-0122-4bc6-8ac4-f39eb781adca tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-34bd3a6d-a293-40d4-84ad-462fe61eb2b9 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:05 devstack sudo[100598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-34bd3a6d-a293-40d4-84ad-462fe61eb2b9
Sep 16 16:21:05 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:05 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e31fdeeb-0122-4bc6-8ac4-f39eb781adca tempest-CreateVolumesFromImageTest-484182616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-34bd3a6d-a293-40d4-84ad-462fe61eb2b9" returned: 0 in 0.283s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e31fdeeb-0122-4bc6-8ac4-f39eb781adca tempest-CreateVolumesFromImageTest-484182616 None] Lock "cinder-quobyte-34bd3a6d-a293-40d4-84ad-462fe61eb2b9" released by "delete_volume" :: held 0.749s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:05 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-e31fdeeb-0122-4bc6-8ac4-f39eb781adca tempest-CreateVolumesFromImageTest-484182616 None] Created reservations ['ff4830c3-a3c4-415e-900d-9a12aeb247de', 'bbdea237-35b4-4615-aa3a-c1067418e297', 'f8593f51-d1d9-4fb0-ad9d-3ded01989451', '45e2f7ef-d848-43bc-999a-76751e143a0e'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:21:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e31fdeeb-0122-4bc6-8ac4-f39eb781adca tempest-CreateVolumesFromImageTest-484182616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e31fdeeb-0122-4bc6-8ac4-f39eb781adca tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e31fdeeb-0122-4bc6-8ac4-f39eb781adca tempest-CreateVolumesFromImageTest-484182616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e31fdeeb-0122-4bc6-8ac4-f39eb781adca tempest-CreateVolumesFromImageTest-484182616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e31fdeeb-0122-4bc6-8ac4-f39eb781adca tempest-CreateVolumesFromImageTest-484182616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e31fdeeb-0122-4bc6-8ac4-f39eb781adca tempest-CreateVolumesFromImageTest-484182616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:05 devstack sudo[100601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:21:05 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:06 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e31fdeeb-0122-4bc6-8ac4-f39eb781adca tempest-CreateVolumesFromImageTest-484182616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.289s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-e31fdeeb-0122-4bc6-8ac4-f39eb781adca tempest-CreateVolumesFromImageTest-484182616 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:21:06 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-e31fdeeb-0122-4bc6-8ac4-f39eb781adca tempest-CreateVolumesFromImageTest-484182616 None] Deleted volume successfully.
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e31fdeeb-0122-4bc6-8ac4-f39eb781adca tempest-CreateVolumesFromImageTest-484182616 None] Lock "cinder-34bd3a6d-a293-40d4-84ad-462fe61eb2b9-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Flow 'volume_create_manager' (4b682093-b63d-47d8-ad10-9b3ffdd8199b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65d3ba5-7ac5-4b7b-ae16-952303ffcfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65d3ba5-7ac5-4b7b-ae16-952303ffcfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1056773581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ef6fe0-4fe3-437a-be77-092e2f647cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08b5c60df7cf4cb1bd1d369eb908aff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:07Z,use_quota=True,user_id='ce91f830a64341a88be8c71adc04903c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1185c261-1779-46c3-a88b-d2dd165f165a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1185c261-1779-46c3-a88b-d2dd165f165a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3a9203-4fb3-4ee5-a005-036622b64b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3a9203-4fb3-4ee5-a005-036622b64b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72ef6fe0-4fe3-437a-be77-092e2f647cde', 'volume_name': 'volume-72ef6fe0-4fe3-437a-be77-092e2f647cde', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff22ee5-390d-4b11-af8f-2c3daa3e33fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff22ee5-390d-4b11-af8f-2c3daa3e33fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10557de-b634-4f60-a6ab-541f70c688d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:06 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Volume 72ef6fe0-4fe3-437a-be77-092e2f647cde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72ef6fe0-4fe3-437a-be77-092e2f647cde', 'volume_size': 1}
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1056773581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ef6fe0-4fe3-437a-be77-092e2f647cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08b5c60df7cf4cb1bd1d369eb908aff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:07Z,use_quota=True,user_id='ce91f830a64341a88be8c71adc04903c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Creating volume 72ef6fe0-4fe3-437a-be77-092e2f647cde {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:21:06 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:21:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-72ef6fe0-4fe3-437a-be77-092e2f647cde 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:06 devstack sudo[100604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-72ef6fe0-4fe3-437a-be77-092e2f647cde 1073741824
Sep 16 16:21:06 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:21:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:07 devstack sudo[100610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:21:07 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:07 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-72ef6fe0-4fe3-437a-be77-092e2f647cde 1073741824" returned: 0 in 0.566s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-72ef6fe0-4fe3-437a-be77-092e2f647cde {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:07 devstack sudo[100612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-72ef6fe0-4fe3-437a-be77-092e2f647cde
Sep 16 16:21:07 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:07 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.350s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:21:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:21:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 29 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:21:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>, <Thread(tpool_thread_0, started daemon 135438770624192)>, <Thread(tpool_thread_1, started daemon 135438762231488)>, <Thread(tpool_thread_2, started daemon 135438753838784)>, <Thread(tpool_thread_3, started daemon 135438745446080)>, <Thread(tpool_thread_4, started daemon 135438737053376)>, <Thread(tpool_thread_5, started daemon 135438728660672)>, <Thread(tpool_thread_6, started daemon 135438720267968)>, <Thread(tpool_thread_7, started daemon 135438711875264)>, <Thread(tpool_thread_8, started daemon 135438703466176)>, <Thread(tpool_thread_9, started daemon 135438695057088)>, <Thread(tpool_thread_10, started daemon 135438686648000)>, <Thread(tpool_thread_11, started daemon 135438678238912)>, <Thread(tpool_thread_12, started daemon 135438669829824)>, <Thread(tpool_thread_13, started daemon 135438661420736)>, <Thread(tpool_thread_14, started daemon 135438653011648)>, <Thread(tpool_thread_15, started daemon 135438644602560)>, <Thread(tpool_thread_16, started daemon 135438636193472)>, <Thread(tpool_thread_17, started daemon 135438627784384)>, <Thread(tpool_thread_18, started daemon 135438619375296)>, <Thread(tpool_thread_19, started daemon 135438610966208)>, <Thread(Rabbit-heartbeat, started daemon 135438772197760)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:21:07 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-72ef6fe0-4fe3-437a-be77-092e2f647cde" returned: 0 in 0.348s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:21:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10557de-b634-4f60-a6ab-541f70c688d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72ef6fe0-4fe3-437a-be77-092e2f647cde', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355944c6-0374-4af2-a50c-706c3a5a24fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:07 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Volume volume-72ef6fe0-4fe3-437a-be77-092e2f647cde (72ef6fe0-4fe3-437a-be77-092e2f647cde): created successfully
Sep 16 16:21:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355944c6-0374-4af2-a50c-706c3a5a24fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Flow 'volume_create_manager' (4b682093-b63d-47d8-ad10-9b3ffdd8199b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:07 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-eea68773-892a-4f61-a7f2-839d6fdf4163 tempest-ProjectReaderTests-1096202172 None] Created volume successfully.
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-89a28f5e-7177-41df-a8a3-45492248b020 tempest-ProjectReaderTests-1096202172 None] Acquiring lock "cinder-72ef6fe0-4fe3-437a-be77-092e2f647cde-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-89a28f5e-7177-41df-a8a3-45492248b020 tempest-ProjectReaderTests-1096202172 None] Lock "cinder-72ef6fe0-4fe3-437a-be77-092e2f647cde-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-89a28f5e-7177-41df-a8a3-45492248b020 tempest-ProjectReaderTests-1096202172 None] Acquiring lock "cinder-quobyte-72ef6fe0-4fe3-437a-be77-092e2f647cde" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-89a28f5e-7177-41df-a8a3-45492248b020 tempest-ProjectReaderTests-1096202172 None] Lock "cinder-quobyte-72ef6fe0-4fe3-437a-be77-092e2f647cde" acquired by "delete_volume" :: waited 0.029s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01434e7-ed5f-439c-98af-6fd5f87a6478]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-89a28f5e-7177-41df-a8a3-45492248b020 tempest-ProjectReaderTests-1096202172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-72ef6fe0-4fe3-437a-be77-092e2f647cde {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:09 devstack sudo[100616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-72ef6fe0-4fe3-437a-be77-092e2f647cde
Sep 16 16:21:09 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Flow 'volume_create_manager' (8779f31d-4173-46a1-90bb-2bca9e862cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee1a7da-a277-480a-96b2-d37f226a5ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee1a7da-a277-480a-96b2-d37f226a5ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-209823468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be59a38160843349314eb4fe7bae480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:09Z,use_quota=True,user_id='c1de9d93a2874db5912cb1d19f384861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e905977d-3658-4ccc-966b-0e2eaeb6663e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e905977d-3658-4ccc-966b-0e2eaeb6663e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f5e695-5f44-4263-b995-df2b7d96a131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f5e695-5f44-4263-b995-df2b7d96a131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3', 'volume_name': 'volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d032a472-078f-44f2-84ac-9db4d81db979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d032a472-078f-44f2-84ac-9db4d81db979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccd0cc95-d86d-4fd0-b3b0-83fb4281a179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:09 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Volume 2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3', 'volume_size': 1}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-209823468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be59a38160843349314eb4fe7bae480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:09Z,use_quota=True,user_id='c1de9d93a2874db5912cb1d19f384861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Creating volume 2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:21:09 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:09 devstack sudo[100619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3 1073741824
Sep 16 16:21:09 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:09 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-89a28f5e-7177-41df-a8a3-45492248b020 tempest-ProjectReaderTests-1096202172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-72ef6fe0-4fe3-437a-be77-092e2f647cde" returned: 0 in 0.470s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-89a28f5e-7177-41df-a8a3-45492248b020 tempest-ProjectReaderTests-1096202172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-72ef6fe0-4fe3-437a-be77-092e2f647cde {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:09 devstack sudo[100623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-72ef6fe0-4fe3-437a-be77-092e2f647cde
Sep 16 16:21:09 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:09 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-89a28f5e-7177-41df-a8a3-45492248b020 tempest-ProjectReaderTests-1096202172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-72ef6fe0-4fe3-437a-be77-092e2f647cde" returned: 0 in 0.317s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-89a28f5e-7177-41df-a8a3-45492248b020 tempest-ProjectReaderTests-1096202172 None] Lock "cinder-quobyte-72ef6fe0-4fe3-437a-be77-092e2f647cde" released by "delete_volume" :: held 0.858s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-89a28f5e-7177-41df-a8a3-45492248b020 tempest-ProjectReaderTests-1096202172 None] Created reservations ['72cedf32-6ee1-4e6c-a950-852e1e4bd11e', 'b43cce31-d659-46b1-9678-7ae8d5243389', 'e6fabcbb-1344-412d-873c-352d29c3428c', '50558bb0-8452-4cef-9b36-5ba368ea571e'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:21:10 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3 1073741824" returned: 0 in 0.545s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-89a28f5e-7177-41df-a8a3-45492248b020 tempest-ProjectReaderTests-1096202172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-89a28f5e-7177-41df-a8a3-45492248b020 tempest-ProjectReaderTests-1096202172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-89a28f5e-7177-41df-a8a3-45492248b020 tempest-ProjectReaderTests-1096202172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-89a28f5e-7177-41df-a8a3-45492248b020 tempest-ProjectReaderTests-1096202172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-89a28f5e-7177-41df-a8a3-45492248b020 tempest-ProjectReaderTests-1096202172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-89a28f5e-7177-41df-a8a3-45492248b020 tempest-ProjectReaderTests-1096202172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:10 devstack sudo[100645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:21:10 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:10 devstack sudo[100646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3
Sep 16 16:21:10 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:10 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-89a28f5e-7177-41df-a8a3-45492248b020 tempest-ProjectReaderTests-1096202172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.374s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-89a28f5e-7177-41df-a8a3-45492248b020 tempest-ProjectReaderTests-1096202172 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:21:10 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:10 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-89a28f5e-7177-41df-a8a3-45492248b020 tempest-ProjectReaderTests-1096202172 None] Deleted volume successfully.
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3" returned: 0 in 0.369s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-89a28f5e-7177-41df-a8a3-45492248b020 tempest-ProjectReaderTests-1096202172 None] Lock "cinder-72ef6fe0-4fe3-437a-be77-092e2f647cde-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccd0cc95-d86d-4fd0-b3b0-83fb4281a179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0acadfe3-20fb-45cc-8cda-1710a8ebb8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:10 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Volume volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3 (2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3): created successfully
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0acadfe3-20fb-45cc-8cda-1710a8ebb8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Flow 'volume_create_manager' (8779f31d-4173-46a1-90bb-2bca9e862cbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:10 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-67625104-1c34-4c90-a0af-b8c1cfaef354 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Created volume successfully.
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Flow 'volume_create_manager' (f60ffcfd-c705-4474-8a16-8ef00a271947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f8e023-8bac-4c99-9f38-9501f508635b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f8e023-8bac-4c99-9f38-9501f508635b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1328946617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d39e125-863c-4ae5-92aa-523995b84c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08b5c60df7cf4cb1bd1d369eb908aff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:11Z,use_quota=True,user_id='ce91f830a64341a88be8c71adc04903c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb41804-2809-4336-b6ee-0e415f19de28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb41804-2809-4336-b6ee-0e415f19de28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337915f0-2df5-4542-bd7b-a218ab973e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337915f0-2df5-4542-bd7b-a218ab973e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d39e125-863c-4ae5-92aa-523995b84c36', 'volume_name': 'volume-9d39e125-863c-4ae5-92aa-523995b84c36', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c50293-994b-4a02-be44-83cc7a0c553a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c50293-994b-4a02-be44-83cc7a0c553a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bccfb5d8-30bb-4d60-82f6-47864821409d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:10 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Volume 9d39e125-863c-4ae5-92aa-523995b84c36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d39e125-863c-4ae5-92aa-523995b84c36', 'volume_size': 1}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1328946617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d39e125-863c-4ae5-92aa-523995b84c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08b5c60df7cf4cb1bd1d369eb908aff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:11Z,use_quota=True,user_id='ce91f830a64341a88be8c71adc04903c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Creating volume 9d39e125-863c-4ae5-92aa-523995b84c36 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:21:10 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:21:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d39e125-863c-4ae5-92aa-523995b84c36 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:10 devstack sudo[100652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d39e125-863c-4ae5-92aa-523995b84c36 1073741824
Sep 16 16:21:10 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:11 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d39e125-863c-4ae5-92aa-523995b84c36 1073741824" returned: 0 in 0.446s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d39e125-863c-4ae5-92aa-523995b84c36 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:11 devstack sudo[100658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d39e125-863c-4ae5-92aa-523995b84c36
Sep 16 16:21:11 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:11 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d39e125-863c-4ae5-92aa-523995b84c36" returned: 0 in 0.297s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:21:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bccfb5d8-30bb-4d60-82f6-47864821409d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d39e125-863c-4ae5-92aa-523995b84c36', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865ace27-37f4-466b-8551-f175a4da2c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:11 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Volume volume-9d39e125-863c-4ae5-92aa-523995b84c36 (9d39e125-863c-4ae5-92aa-523995b84c36): created successfully
Sep 16 16:21:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865ace27-37f4-466b-8551-f175a4da2c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Flow 'volume_create_manager' (f60ffcfd-c705-4474-8a16-8ef00a271947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:11 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c5deb5ce-f0c1-4d87-b55d-2607b757d772 tempest-ProjectReaderTests-1096202172 None] Created volume successfully.
Sep 16 16:21:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9b9c2a2b-cce3-40ef-b43e-2d31eb68be85 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9b9c2a2b-cce3-40ef-b43e-2d31eb68be85 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-9b9c2a2b-cce3-40ef-b43e-2d31eb68be85 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Creating offline snapshot ecd638e2-f01b-4d6d-9303-ceec64664b64 of volume 2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:21:11 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7da95d3-45e6-497a-a71d-e64fb07d26e9]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b9c2a2b-cce3-40ef-b43e-2d31eb68be85 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:11 devstack sudo[100661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3
Sep 16 16:21:11 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:12 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b9c2a2b-cce3-40ef-b43e-2d31eb68be85 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3" returned: 0 in 0.433s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b9c2a2b-cce3-40ef-b43e-2d31eb68be85 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.ecd638e2-f01b-4d6d-9303-ceec64664b64 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:12 devstack sudo[100666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.ecd638e2-f01b-4d6d-9303-ceec64664b64 1G
Sep 16 16:21:12 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:12 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b9c2a2b-cce3-40ef-b43e-2d31eb68be85 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.ecd638e2-f01b-4d6d-9303-ceec64664b64 1G" returned: 0 in 0.440s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b9c2a2b-cce3-40ef-b43e-2d31eb68be85 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.ecd638e2-f01b-4d6d-9303-ceec64664b64 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:12 devstack sudo[100678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.ecd638e2-f01b-4d6d-9303-ceec64664b64
Sep 16 16:21:12 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-582d5fe9-a062-46d1-bceb-e882052e2f0d tempest-ProjectReaderTests-1096202172 None] Acquiring lock "cinder-9d39e125-863c-4ae5-92aa-523995b84c36-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-582d5fe9-a062-46d1-bceb-e882052e2f0d tempest-ProjectReaderTests-1096202172 None] Lock "cinder-9d39e125-863c-4ae5-92aa-523995b84c36-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-582d5fe9-a062-46d1-bceb-e882052e2f0d tempest-ProjectReaderTests-1096202172 None] Acquiring lock "cinder-quobyte-9d39e125-863c-4ae5-92aa-523995b84c36" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-582d5fe9-a062-46d1-bceb-e882052e2f0d tempest-ProjectReaderTests-1096202172 None] Lock "cinder-quobyte-9d39e125-863c-4ae5-92aa-523995b84c36" acquired by "delete_volume" :: waited 0.014s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2783dde4-4667-4f52-a5ed-c28ad5bc8fa5]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-582d5fe9-a062-46d1-bceb-e882052e2f0d tempest-ProjectReaderTests-1096202172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d39e125-863c-4ae5-92aa-523995b84c36 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:13 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b9c2a2b-cce3-40ef-b43e-2d31eb68be85 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.ecd638e2-f01b-4d6d-9303-ceec64664b64" returned: 0 in 0.358s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:13 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-9b9c2a2b-cce3-40ef-b43e-2d31eb68be85 tempest-CreateVolumesFromSnapshotTest-1089480911 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.ecd638e2-f01b-4d6d-9303-ceec64664b64 is being set with open permissions: ugo+rw
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b9c2a2b-cce3-40ef-b43e-2d31eb68be85 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.ecd638e2-f01b-4d6d-9303-ceec64664b64 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:13 devstack sudo[100684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.ecd638e2-f01b-4d6d-9303-ceec64664b64
Sep 16 16:21:13 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:13 devstack sudo[100683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d39e125-863c-4ae5-92aa-523995b84c36
Sep 16 16:21:13 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:13 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b9c2a2b-cce3-40ef-b43e-2d31eb68be85 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.ecd638e2-f01b-4d6d-9303-ceec64664b64" returned: 0 in 0.253s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b9c2a2b-cce3-40ef-b43e-2d31eb68be85 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:13 devstack sudo[100690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.info
Sep 16 16:21:13 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:13 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-582d5fe9-a062-46d1-bceb-e882052e2f0d tempest-ProjectReaderTests-1096202172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d39e125-863c-4ae5-92aa-523995b84c36" returned: 0 in 0.380s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-582d5fe9-a062-46d1-bceb-e882052e2f0d tempest-ProjectReaderTests-1096202172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d39e125-863c-4ae5-92aa-523995b84c36 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:13 devstack sudo[100693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d39e125-863c-4ae5-92aa-523995b84c36
Sep 16 16:21:13 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:13 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b9c2a2b-cce3-40ef-b43e-2d31eb68be85 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.info" returned: 0 in 0.282s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:13 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-9b9c2a2b-cce3-40ef-b43e-2d31eb68be85 tempest-CreateVolumesFromSnapshotTest-1089480911 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.info is being set with open permissions: ugo+rw
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b9c2a2b-cce3-40ef-b43e-2d31eb68be85 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:13 devstack sudo[100696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.info
Sep 16 16:21:13 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:13 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-582d5fe9-a062-46d1-bceb-e882052e2f0d tempest-ProjectReaderTests-1096202172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d39e125-863c-4ae5-92aa-523995b84c36" returned: 0 in 0.260s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-582d5fe9-a062-46d1-bceb-e882052e2f0d tempest-ProjectReaderTests-1096202172 None] Lock "cinder-quobyte-9d39e125-863c-4ae5-92aa-523995b84c36" released by "delete_volume" :: held 0.689s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-582d5fe9-a062-46d1-bceb-e882052e2f0d tempest-ProjectReaderTests-1096202172 None] Created reservations ['0a72aeb9-bea2-4a0e-b50a-edef18755de1', 'f13eaa2e-d011-4aa3-9b3c-744cea845946', 'a5521ac2-705f-4266-a875-1622a99f4b17', '3af01322-f736-4a3d-83a5-04887cd36c18'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-582d5fe9-a062-46d1-bceb-e882052e2f0d tempest-ProjectReaderTests-1096202172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-582d5fe9-a062-46d1-bceb-e882052e2f0d tempest-ProjectReaderTests-1096202172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-582d5fe9-a062-46d1-bceb-e882052e2f0d tempest-ProjectReaderTests-1096202172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-582d5fe9-a062-46d1-bceb-e882052e2f0d tempest-ProjectReaderTests-1096202172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-582d5fe9-a062-46d1-bceb-e882052e2f0d tempest-ProjectReaderTests-1096202172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-582d5fe9-a062-46d1-bceb-e882052e2f0d tempest-ProjectReaderTests-1096202172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:13 devstack sudo[100699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:21:13 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:13 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b9c2a2b-cce3-40ef-b43e-2d31eb68be85 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.info" returned: 0 in 0.252s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9b9c2a2b-cce3-40ef-b43e-2d31eb68be85 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.119s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:13 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-9b9c2a2b-cce3-40ef-b43e-2d31eb68be85 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Create snapshot completed successfully
Sep 16 16:21:14 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-582d5fe9-a062-46d1-bceb-e882052e2f0d tempest-ProjectReaderTests-1096202172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.276s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-582d5fe9-a062-46d1-bceb-e882052e2f0d tempest-ProjectReaderTests-1096202172 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:21:14 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-582d5fe9-a062-46d1-bceb-e882052e2f0d tempest-ProjectReaderTests-1096202172 None] Deleted volume successfully.
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-582d5fe9-a062-46d1-bceb-e882052e2f0d tempest-ProjectReaderTests-1096202172 None] Lock "cinder-9d39e125-863c-4ae5-92aa-523995b84c36-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Flow 'volume_create_manager' (d49caffb-3be4-4a6f-9b2c-c15189a9f3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86aefab1-5902-463e-a65f-ca8594cd7967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86aefab1-5902-463e-a65f-ca8594cd7967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1224713146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9428e28-7f32-45da-a2de-e16c2ca26b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08b5c60df7cf4cb1bd1d369eb908aff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:15Z,use_quota=True,user_id='ce91f830a64341a88be8c71adc04903c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ae76ab-eef5-486b-bf4c-8b085ad5149c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ae76ab-eef5-486b-bf4c-8b085ad5149c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfad5c1b-7336-4ddb-95e7-577df07b18c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfad5c1b-7336-4ddb-95e7-577df07b18c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9428e28-7f32-45da-a2de-e16c2ca26b81', 'volume_name': 'volume-c9428e28-7f32-45da-a2de-e16c2ca26b81', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc1c887-1c9c-4ca4-8324-9324817ad97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc1c887-1c9c-4ca4-8324-9324817ad97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (547722d2-3bda-42d7-adaf-b38b979c69fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:14 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Volume c9428e28-7f32-45da-a2de-e16c2ca26b81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9428e28-7f32-45da-a2de-e16c2ca26b81', 'volume_size': 1}
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1224713146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9428e28-7f32-45da-a2de-e16c2ca26b81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08b5c60df7cf4cb1bd1d369eb908aff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:15Z,use_quota=True,user_id='ce91f830a64341a88be8c71adc04903c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Creating volume c9428e28-7f32-45da-a2de-e16c2ca26b81 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:21:14 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:21:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c9428e28-7f32-45da-a2de-e16c2ca26b81 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:14 devstack sudo[100703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c9428e28-7f32-45da-a2de-e16c2ca26b81 1073741824
Sep 16 16:21:14 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:15 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c9428e28-7f32-45da-a2de-e16c2ca26b81 1073741824" returned: 0 in 0.456s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c9428e28-7f32-45da-a2de-e16c2ca26b81 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:15 devstack sudo[100708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c9428e28-7f32-45da-a2de-e16c2ca26b81
Sep 16 16:21:15 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Flow 'volume_create_manager' (3d60b50f-75d9-441a-a85f-cc3b829401ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:15 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bcce52a-6230-4d73-bfec-fa68350f31f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c9428e28-7f32-45da-a2de-e16c2ca26b81" returned: 0 in 0.320s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bcce52a-6230-4d73-bfec-fa68350f31f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1084262668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbea5216-f1a7-46f7-aa94-4c27f7db3b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be59a38160843349314eb4fe7bae480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:15Z,use_quota=True,user_id='c1de9d93a2874db5912cb1d19f384861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6529188-be44-4183-868c-22256dcfd8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6529188-be44-4183-868c-22256dcfd8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3809b5ed-42d5-457f-a0c2-0e8ce37037be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3809b5ed-42d5-457f-a0c2-0e8ce37037be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbea5216-f1a7-46f7-aa94-4c27f7db3b36', 'volume_name': 'volume-cbea5216-f1a7-46f7-aa94-4c27f7db3b36', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f265fd8-4669-44d4-b879-6fa38100f9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f265fd8-4669-44d4-b879-6fa38100f9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1c3c61-d1b2-4b07-a131-fbf3e5b3efb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:15 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Volume cbea5216-f1a7-46f7-aa94-4c27f7db3b36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbea5216-f1a7-46f7-aa94-4c27f7db3b36', 'volume_size': 1}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1084262668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbea5216-f1a7-46f7-aa94-4c27f7db3b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be59a38160843349314eb4fe7bae480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:15Z,use_quota=True,user_id='c1de9d93a2874db5912cb1d19f384861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Creating volume cbea5216-f1a7-46f7-aa94-4c27f7db3b36 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:21:15 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cbea5216-f1a7-46f7-aa94-4c27f7db3b36 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:15 devstack sudo[100711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cbea5216-f1a7-46f7-aa94-4c27f7db3b36 1073741824
Sep 16 16:21:15 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (547722d2-3bda-42d7-adaf-b38b979c69fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9428e28-7f32-45da-a2de-e16c2ca26b81', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871d1223-558c-4c8e-96a9-96629e32127d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:15 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Volume volume-c9428e28-7f32-45da-a2de-e16c2ca26b81 (c9428e28-7f32-45da-a2de-e16c2ca26b81): created successfully
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871d1223-558c-4c8e-96a9-96629e32127d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Flow 'volume_create_manager' (d49caffb-3be4-4a6f-9b2c-c15189a9f3ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:15 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-09ad9e90-f177-4be9-80c0-510dd875b3b9 tempest-ProjectReaderTests-1096202172 None] Created volume successfully.
Sep 16 16:21:15 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Flow 'volume_create_manager' (879035ed-bd9a-4316-abd3-c2d6e6d64026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0a8988-e611-449c-a621-f6eef810f235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0a8988-e611-449c-a621-f6eef810f235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1738346891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d92e620-41fb-48bb-9ddb-a1502fd098fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be59a38160843349314eb4fe7bae480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:16Z,use_quota=True,user_id='c1de9d93a2874db5912cb1d19f384861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb303cb-8f13-483b-b291-07757fd938b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb303cb-8f13-483b-b291-07757fd938b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ee60b9-913b-4be0-ad72-d97b2ad65397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ee60b9-913b-4be0-ad72-d97b2ad65397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d92e620-41fb-48bb-9ddb-a1502fd098fd', 'volume_name': 'volume-2d92e620-41fb-48bb-9ddb-a1502fd098fd', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17351955-d3e7-48fa-9026-eed9b832ec8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17351955-d3e7-48fa-9026-eed9b832ec8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b9ba1fd-1da0-4840-8ecb-6478dad3bfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:16 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Volume 2d92e620-41fb-48bb-9ddb-a1502fd098fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d92e620-41fb-48bb-9ddb-a1502fd098fd', 'volume_size': 1}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:16 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cbea5216-f1a7-46f7-aa94-4c27f7db3b36 1073741824" returned: 0 in 0.703s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cbea5216-f1a7-46f7-aa94-4c27f7db3b36 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:16 devstack sudo[100717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cbea5216-f1a7-46f7-aa94-4c27f7db3b36
Sep 16 16:21:16 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Flow 'volume_create_manager' (26caaabd-6741-42f1-8b91-33d90413ce0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717424e2-a213-431c-9d8c-60dfc352b75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717424e2-a213-431c-9d8c-60dfc352b75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1898896066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae14d9a-76ba-4763-8a57-41524062308d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be59a38160843349314eb4fe7bae480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:16Z,use_quota=True,user_id='c1de9d93a2874db5912cb1d19f384861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8574e4-0473-45bf-9805-9e1e7d13673d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8574e4-0473-45bf-9805-9e1e7d13673d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac2c27a-8735-4e38-b4f0-58de229d7c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac2c27a-8735-4e38-b4f0-58de229d7c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cae14d9a-76ba-4763-8a57-41524062308d', 'volume_name': 'volume-cae14d9a-76ba-4763-8a57-41524062308d', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77cd4e51-1046-461e-a9c5-a7d15e9fd5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77cd4e51-1046-461e-a9c5-a7d15e9fd5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68be806c-ce06-4237-9219-6ae498fd0f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:16 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Volume cae14d9a-76ba-4763-8a57-41524062308d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cae14d9a-76ba-4763-8a57-41524062308d', 'volume_size': 1}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:16 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cbea5216-f1a7-46f7-aa94-4c27f7db3b36" returned: 0 in 0.373s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.619s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1738346891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d92e620-41fb-48bb-9ddb-a1502fd098fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be59a38160843349314eb4fe7bae480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:16Z,use_quota=True,user_id='c1de9d93a2874db5912cb1d19f384861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Creating volume 2d92e620-41fb-48bb-9ddb-a1502fd098fd {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:21:16 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d92e620-41fb-48bb-9ddb-a1502fd098fd 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:16 devstack sudo[100720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d92e620-41fb-48bb-9ddb-a1502fd098fd 1073741824
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1c3c61-d1b2-4b07-a131-fbf3e5b3efb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbea5216-f1a7-46f7-aa94-4c27f7db3b36', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:16 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aedca69-9cd2-44fe-893b-ef9ae484be49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:16 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Volume volume-cbea5216-f1a7-46f7-aa94-4c27f7db3b36 (cbea5216-f1a7-46f7-aa94-4c27f7db3b36): created successfully
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aedca69-9cd2-44fe-893b-ef9ae484be49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Flow 'volume_create_manager' (3d60b50f-75d9-441a-a85f-cc3b829401ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:16 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-18ac5b38-cdae-4a9b-958e-8452c693c064 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Created volume successfully.
Sep 16 16:21:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-8808665b-535f-4e5e-bb52-195fed8cee67 tempest-ProjectReaderTests-1096202172 None] Acquiring lock "cinder-c9428e28-7f32-45da-a2de-e16c2ca26b81-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-8808665b-535f-4e5e-bb52-195fed8cee67 tempest-ProjectReaderTests-1096202172 None] Lock "cinder-c9428e28-7f32-45da-a2de-e16c2ca26b81-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Flow 'volume_create_manager' (205c7dc5-015e-4d2c-93ea-556821370b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b8bcf5-46a8-43fc-aa39-30b6e092a8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b8bcf5-46a8-43fc-aa39-30b6e092a8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1518656924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c7f669-48d6-42d8-873f-b0ef5e3366e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be59a38160843349314eb4fe7bae480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:17Z,use_quota=True,user_id='c1de9d93a2874db5912cb1d19f384861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76323fc6-e10e-4bed-a1ad-22bc2e4dbb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76323fc6-e10e-4bed-a1ad-22bc2e4dbb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cbec939-ce59-42f9-849c-ead39f2858f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cbec939-ce59-42f9-849c-ead39f2858f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87c7f669-48d6-42d8-873f-b0ef5e3366e5', 'volume_name': 'volume-87c7f669-48d6-42d8-873f-b0ef5e3366e5', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf40a633-a39b-4973-add8-d716c143410b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf40a633-a39b-4973-add8-d716c143410b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08080d5c-484a-4b29-91fe-309bfb7cf81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:17 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Volume 87c7f669-48d6-42d8-873f-b0ef5e3366e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87c7f669-48d6-42d8-873f-b0ef5e3366e5', 'volume_size': 1}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-8808665b-535f-4e5e-bb52-195fed8cee67 tempest-ProjectReaderTests-1096202172 None] Acquiring lock "cinder-quobyte-c9428e28-7f32-45da-a2de-e16c2ca26b81" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-8808665b-535f-4e5e-bb52-195fed8cee67 tempest-ProjectReaderTests-1096202172 None] Lock "cinder-quobyte-c9428e28-7f32-45da-a2de-e16c2ca26b81" acquired by "delete_volume" :: waited 0.018s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de2adcd-abf5-4cd4-b89c-c47e552da318]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8808665b-535f-4e5e-bb52-195fed8cee67 tempest-ProjectReaderTests-1096202172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c9428e28-7f32-45da-a2de-e16c2ca26b81 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:17 devstack sudo[100726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c9428e28-7f32-45da-a2de-e16c2ca26b81
Sep 16 16:21:17 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:17 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d92e620-41fb-48bb-9ddb-a1502fd098fd 1073741824" returned: 0 in 0.765s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d92e620-41fb-48bb-9ddb-a1502fd098fd {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:17 devstack sudo[100729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d92e620-41fb-48bb-9ddb-a1502fd098fd
Sep 16 16:21:17 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Flow 'volume_create_manager' (57fb4954-d0b1-47ce-8720-fcc9daad9368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6689a3-68c2-451b-ba81-b1105f7d160d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6689a3-68c2-451b-ba81-b1105f7d160d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1340344328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c151ba8e-30e0-422f-8aca-3797b8e91f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be59a38160843349314eb4fe7bae480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:18Z,use_quota=True,user_id='c1de9d93a2874db5912cb1d19f384861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073b74e5-1409-497d-a267-2b536fa3d6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073b74e5-1409-497d-a267-2b536fa3d6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed13a7ef-1aa0-4359-9558-9b1bda489a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed13a7ef-1aa0-4359-9558-9b1bda489a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c151ba8e-30e0-422f-8aca-3797b8e91f33', 'volume_name': 'volume-c151ba8e-30e0-422f-8aca-3797b8e91f33', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d89cff-7bc9-449d-9b8b-fd3bf88a575b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d89cff-7bc9-449d-9b8b-fd3bf88a575b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:17 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f389990-1b15-4042-b5b5-f323db078eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:17 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Volume c151ba8e-30e0-422f-8aca-3797b8e91f33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c151ba8e-30e0-422f-8aca-3797b8e91f33', 'volume_size': 1}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8808665b-535f-4e5e-bb52-195fed8cee67 tempest-ProjectReaderTests-1096202172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c9428e28-7f32-45da-a2de-e16c2ca26b81" returned: 0 in 0.544s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8808665b-535f-4e5e-bb52-195fed8cee67 tempest-ProjectReaderTests-1096202172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c9428e28-7f32-45da-a2de-e16c2ca26b81 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:17 devstack sudo[100734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c9428e28-7f32-45da-a2de-e16c2ca26b81
Sep 16 16:21:17 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:17 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d92e620-41fb-48bb-9ddb-a1502fd098fd" returned: 0 in 0.315s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.206s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1898896066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae14d9a-76ba-4763-8a57-41524062308d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be59a38160843349314eb4fe7bae480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:16Z,use_quota=True,user_id='c1de9d93a2874db5912cb1d19f384861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Creating volume cae14d9a-76ba-4763-8a57-41524062308d {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:21:17 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cae14d9a-76ba-4763-8a57-41524062308d 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b9ba1fd-1da0-4840-8ecb-6478dad3bfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d92e620-41fb-48bb-9ddb-a1502fd098fd', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:17 devstack sudo[100737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cae14d9a-76ba-4763-8a57-41524062308d 1073741824
Sep 16 16:21:17 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853c718f-3a40-4b75-bfcb-3b5ac12165f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:17 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Volume volume-2d92e620-41fb-48bb-9ddb-a1502fd098fd (2d92e620-41fb-48bb-9ddb-a1502fd098fd): created successfully
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (853c718f-3a40-4b75-bfcb-3b5ac12165f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Flow 'volume_create_manager' (879035ed-bd9a-4316-abd3-c2d6e6d64026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:17 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c1c80947-9a7f-4d02-93ef-b6c0cfbfd0d0 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Created volume successfully.
Sep 16 16:21:18 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8808665b-535f-4e5e-bb52-195fed8cee67 tempest-ProjectReaderTests-1096202172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c9428e28-7f32-45da-a2de-e16c2ca26b81" returned: 0 in 0.268s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-8808665b-535f-4e5e-bb52-195fed8cee67 tempest-ProjectReaderTests-1096202172 None] Lock "cinder-quobyte-c9428e28-7f32-45da-a2de-e16c2ca26b81" released by "delete_volume" :: held 0.857s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-8808665b-535f-4e5e-bb52-195fed8cee67 tempest-ProjectReaderTests-1096202172 None] Created reservations ['93ff68cb-98cf-487d-bcb9-6dfa45ec8631', '1a1d51e3-6195-4621-8320-2e8e92634bcc', 'db6db290-a28b-403c-92b1-b64b62293280', '516c46e7-120c-462b-a6b0-a5af5d7d589c'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8808665b-535f-4e5e-bb52-195fed8cee67 tempest-ProjectReaderTests-1096202172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8808665b-535f-4e5e-bb52-195fed8cee67 tempest-ProjectReaderTests-1096202172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8808665b-535f-4e5e-bb52-195fed8cee67 tempest-ProjectReaderTests-1096202172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8808665b-535f-4e5e-bb52-195fed8cee67 tempest-ProjectReaderTests-1096202172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8808665b-535f-4e5e-bb52-195fed8cee67 tempest-ProjectReaderTests-1096202172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8808665b-535f-4e5e-bb52-195fed8cee67 tempest-ProjectReaderTests-1096202172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:18 devstack sudo[100743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:21:18 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:18 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cae14d9a-76ba-4763-8a57-41524062308d 1073741824" returned: 0 in 0.504s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cae14d9a-76ba-4763-8a57-41524062308d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:18 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8808665b-535f-4e5e-bb52-195fed8cee67 tempest-ProjectReaderTests-1096202172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.280s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-8808665b-535f-4e5e-bb52-195fed8cee67 tempest-ProjectReaderTests-1096202172 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:21:18 devstack sudo[100747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cae14d9a-76ba-4763-8a57-41524062308d
Sep 16 16:21:18 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:18 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-8808665b-535f-4e5e-bb52-195fed8cee67 tempest-ProjectReaderTests-1096202172 None] Deleted volume successfully.
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-8808665b-535f-4e5e-bb52-195fed8cee67 tempest-ProjectReaderTests-1096202172 None] Lock "cinder-c9428e28-7f32-45da-a2de-e16c2ca26b81-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:18 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cae14d9a-76ba-4763-8a57-41524062308d" returned: 0 in 0.292s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.590s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1518656924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c7f669-48d6-42d8-873f-b0ef5e3366e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be59a38160843349314eb4fe7bae480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:17Z,use_quota=True,user_id='c1de9d93a2874db5912cb1d19f384861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Creating volume 87c7f669-48d6-42d8-873f-b0ef5e3366e5 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:21:18 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87c7f669-48d6-42d8-873f-b0ef5e3366e5 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:18 devstack sudo[100750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87c7f669-48d6-42d8-873f-b0ef5e3366e5 1073741824
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68be806c-ce06-4237-9219-6ae498fd0f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cae14d9a-76ba-4763-8a57-41524062308d', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:18 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28315a4c-863f-4dda-ba97-0eab4e8751d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:18 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Volume volume-cae14d9a-76ba-4763-8a57-41524062308d (cae14d9a-76ba-4763-8a57-41524062308d): created successfully
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28315a4c-863f-4dda-ba97-0eab4e8751d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Flow 'volume_create_manager' (26caaabd-6741-42f1-8b91-33d90413ce0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:18 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c2fefb02-5fea-41fc-bb20-56cfceb52090 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Created volume successfully.
Sep 16 16:21:19 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87c7f669-48d6-42d8-873f-b0ef5e3366e5 1073741824" returned: 0 in 0.423s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87c7f669-48d6-42d8-873f-b0ef5e3366e5 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:19 devstack sudo[100756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87c7f669-48d6-42d8-873f-b0ef5e3366e5
Sep 16 16:21:19 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:19 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87c7f669-48d6-42d8-873f-b0ef5e3366e5" returned: 0 in 0.282s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:21:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.752s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1340344328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c151ba8e-30e0-422f-8aca-3797b8e91f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be59a38160843349314eb4fe7bae480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:18Z,use_quota=True,user_id='c1de9d93a2874db5912cb1d19f384861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:21:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Creating volume c151ba8e-30e0-422f-8aca-3797b8e91f33 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:21:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:21:19 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:21:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c151ba8e-30e0-422f-8aca-3797b8e91f33 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:19 devstack sudo[100760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c151ba8e-30e0-422f-8aca-3797b8e91f33 1073741824
Sep 16 16:21:19 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08080d5c-484a-4b29-91fe-309bfb7cf81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87c7f669-48d6-42d8-873f-b0ef5e3366e5', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a49aa649-f942-4450-a894-8faf245ae09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:19 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Volume volume-87c7f669-48d6-42d8-873f-b0ef5e3366e5 (87c7f669-48d6-42d8-873f-b0ef5e3366e5): created successfully
Sep 16 16:21:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a49aa649-f942-4450-a894-8faf245ae09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Flow 'volume_create_manager' (205c7dc5-015e-4d2c-93ea-556821370b9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:19 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-024a32df-00ac-4ade-82a0-450f8e3c659d tempest-CreateVolumesFromSnapshotTest-1089480911 None] Created volume successfully.
Sep 16 16:21:19 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:21:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Flow 'volume_create_manager' (80850565-f3b7-4646-a51a-18b0750c2e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4b4319-f16c-4815-bf23-df47a714bdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4b4319-f16c-4815-bf23-df47a714bdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-330795690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0a9689-c8a3-44b1-a779-f0615ed2439d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08b5c60df7cf4cb1bd1d369eb908aff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:20Z,use_quota=True,user_id='ce91f830a64341a88be8c71adc04903c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7985dbe0-4242-4d6a-b04a-6b41464ad20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7985dbe0-4242-4d6a-b04a-6b41464ad20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9602ab3-11c0-4773-af31-17e36cd1e070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9602ab3-11c0-4773-af31-17e36cd1e070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a0a9689-c8a3-44b1-a779-f0615ed2439d', 'volume_name': 'volume-8a0a9689-c8a3-44b1-a779-f0615ed2439d', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f316c19c-b330-42c2-b20d-188e52a5677a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f316c19c-b330-42c2-b20d-188e52a5677a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3002ba-8dff-4f07-bda4-950c536d6af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:20 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Volume 8a0a9689-c8a3-44b1-a779-f0615ed2439d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a0a9689-c8a3-44b1-a779-f0615ed2439d', 'volume_size': 1}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:20 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c151ba8e-30e0-422f-8aca-3797b8e91f33 1073741824" returned: 0 in 0.589s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Flow 'volume_create_manager' (68945a37-6918-40ca-8580-9ceeb7dd9ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c9d584-24d8-4c00-819b-0f89e22c6b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c9d584-24d8-4c00-819b-0f89e22c6b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-714943253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228052aae74d48618ef82bc2ad1c5439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:20Z,use_quota=True,user_id='5f8584f68ab64336866b6fb822a42f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a7e6c4-86a5-4485-94b0-923b1f9f9ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a7e6c4-86a5-4485-94b0-923b1f9f9ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9849e90b-0231-43db-ae71-965bb47c46b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9849e90b-0231-43db-ae71-965bb47c46b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c', 'volume_name': 'volume-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ab1274-e850-451c-a132-feb82b3aca5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ab1274-e850-451c-a132-feb82b3aca5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcc3b497-62cf-4ae8-8390-e58bad4489ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:20 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Volume a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c', 'volume_size': 1}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c151ba8e-30e0-422f-8aca-3797b8e91f33 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:20 devstack sudo[100766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c151ba8e-30e0-422f-8aca-3797b8e91f33
Sep 16 16:21:20 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:20 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c151ba8e-30e0-422f-8aca-3797b8e91f33" returned: 0 in 0.252s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.454s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-330795690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a0a9689-c8a3-44b1-a779-f0615ed2439d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08b5c60df7cf4cb1bd1d369eb908aff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:20Z,use_quota=True,user_id='ce91f830a64341a88be8c71adc04903c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Creating volume 8a0a9689-c8a3-44b1-a779-f0615ed2439d {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:21:20 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a0a9689-c8a3-44b1-a779-f0615ed2439d 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:20 devstack sudo[100769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a0a9689-c8a3-44b1-a779-f0615ed2439d 1073741824
Sep 16 16:21:20 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f389990-1b15-4042-b5b5-f323db078eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c151ba8e-30e0-422f-8aca-3797b8e91f33', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8232e490-a020-430b-9053-37fd1ab3b5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:20 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Volume volume-c151ba8e-30e0-422f-8aca-3797b8e91f33 (c151ba8e-30e0-422f-8aca-3797b8e91f33): created successfully
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8232e490-a020-430b-9053-37fd1ab3b5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Flow 'volume_create_manager' (57fb4954-d0b1-47ce-8720-fcc9daad9368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:20 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-843715c5-b0cf-4211-be4b-41f080c912d7 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Created volume successfully.
Sep 16 16:21:20 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a0a9689-c8a3-44b1-a779-f0615ed2439d 1073741824" returned: 0 in 0.428s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a0a9689-c8a3-44b1-a779-f0615ed2439d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:21 devstack sudo[100776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a0a9689-c8a3-44b1-a779-f0615ed2439d
Sep 16 16:21:21 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9b6ef8f3-b59b-45cf-b270-bc34be522d20 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "cinder-c151ba8e-30e0-422f-8aca-3797b8e91f33-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9b6ef8f3-b59b-45cf-b270-bc34be522d20 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-c151ba8e-30e0-422f-8aca-3797b8e91f33-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9b6ef8f3-b59b-45cf-b270-bc34be522d20 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "cinder-quobyte-c151ba8e-30e0-422f-8aca-3797b8e91f33" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9b6ef8f3-b59b-45cf-b270-bc34be522d20 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-quobyte-c151ba8e-30e0-422f-8aca-3797b8e91f33" acquired by "delete_volume" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9353e7c0-7dcc-45db-9bf2-2d3942b9f355]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b6ef8f3-b59b-45cf-b270-bc34be522d20 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c151ba8e-30e0-422f-8aca-3797b8e91f33 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:21 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a0a9689-c8a3-44b1-a779-f0615ed2439d" returned: 0 in 0.298s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.055s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-714943253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228052aae74d48618ef82bc2ad1c5439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:20Z,use_quota=True,user_id='5f8584f68ab64336866b6fb822a42f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Creating volume a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:21:21 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:21 devstack sudo[100780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c 1073741824
Sep 16 16:21:21 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3002ba-8dff-4f07-bda4-950c536d6af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a0a9689-c8a3-44b1-a779-f0615ed2439d', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6636497d-8059-4295-8002-48d9e07ce45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:21 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Volume volume-8a0a9689-c8a3-44b1-a779-f0615ed2439d (8a0a9689-c8a3-44b1-a779-f0615ed2439d): created successfully
Sep 16 16:21:21 devstack sudo[100779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c151ba8e-30e0-422f-8aca-3797b8e91f33
Sep 16 16:21:21 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6636497d-8059-4295-8002-48d9e07ce45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Flow 'volume_create_manager' (80850565-f3b7-4646-a51a-18b0750c2e65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:21 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-a7dfc840-e1b2-419b-815f-ac9d81643705 tempest-ProjectReaderTests-1096202172 None] Created volume successfully.
Sep 16 16:21:21 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b6ef8f3-b59b-45cf-b270-bc34be522d20 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c151ba8e-30e0-422f-8aca-3797b8e91f33" returned: 0 in 0.396s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b6ef8f3-b59b-45cf-b270-bc34be522d20 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c151ba8e-30e0-422f-8aca-3797b8e91f33 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:21 devstack sudo[100789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c151ba8e-30e0-422f-8aca-3797b8e91f33
Sep 16 16:21:21 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:21 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c 1073741824" returned: 0 in 0.464s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:21 devstack sudo[100792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c
Sep 16 16:21:21 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:21 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b6ef8f3-b59b-45cf-b270-bc34be522d20 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c151ba8e-30e0-422f-8aca-3797b8e91f33" returned: 0 in 0.270s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9b6ef8f3-b59b-45cf-b270-bc34be522d20 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-quobyte-c151ba8e-30e0-422f-8aca-3797b8e91f33" released by "delete_volume" :: held 0.724s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fbc2350f-92d8-4164-80d1-33174068b120 tempest-ProjectReaderTests-1096202172 None] Acquiring lock "cinder-8a0a9689-c8a3-44b1-a779-f0615ed2439d-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:21 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-9b6ef8f3-b59b-45cf-b270-bc34be522d20 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Created reservations ['192debbf-9848-4887-a6dc-b54796948039', '3e103eb3-8a4e-4e05-9170-295bdb7a8101', 'f6c056e7-6728-431d-9537-79db23404eb5', '4d7750c0-133a-4752-8414-557ce9b38401'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fbc2350f-92d8-4164-80d1-33174068b120 tempest-ProjectReaderTests-1096202172 None] Lock "cinder-8a0a9689-c8a3-44b1-a779-f0615ed2439d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fbc2350f-92d8-4164-80d1-33174068b120 tempest-ProjectReaderTests-1096202172 None] Acquiring lock "cinder-quobyte-8a0a9689-c8a3-44b1-a779-f0615ed2439d" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9b6ef8f3-b59b-45cf-b270-bc34be522d20 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9b6ef8f3-b59b-45cf-b270-bc34be522d20 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9b6ef8f3-b59b-45cf-b270-bc34be522d20 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:22 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9b6ef8f3-b59b-45cf-b270-bc34be522d20 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9b6ef8f3-b59b-45cf-b270-bc34be522d20 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b6ef8f3-b59b-45cf-b270-bc34be522d20 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fbc2350f-92d8-4164-80d1-33174068b120 tempest-ProjectReaderTests-1096202172 None] Lock "cinder-quobyte-8a0a9689-c8a3-44b1-a779-f0615ed2439d" acquired by "delete_volume" :: waited 0.056s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:22 devstack sudo[100796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:21:22 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c" returned: 0 in 0.357s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcc3b497-62cf-4ae8-8390-e58bad4489ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6dc7194-e662-402d-958a-47acaf5ef8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6f01ea-1aba-46b5-a07c-0a4b082ca258]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fbc2350f-92d8-4164-80d1-33174068b120 tempest-ProjectReaderTests-1096202172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a0a9689-c8a3-44b1-a779-f0615ed2439d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:22 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Volume volume-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c (a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c): created successfully
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6dc7194-e662-402d-958a-47acaf5ef8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Flow 'volume_create_manager' (68945a37-6918-40ca-8580-9ceeb7dd9ad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:22 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-97bd77e0-3cbc-4740-af95-deae9e422972 tempest-AttachVolumeNegativeTest-909556830 None] Created volume successfully.
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e563aebf-1bff-463f-946d-1ba1eaf6d403 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "cinder-87c7f669-48d6-42d8-873f-b0ef5e3366e5-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:22 devstack sudo[100798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a0a9689-c8a3-44b1-a779-f0615ed2439d
Sep 16 16:21:22 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e563aebf-1bff-463f-946d-1ba1eaf6d403 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-87c7f669-48d6-42d8-873f-b0ef5e3366e5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:22 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b6ef8f3-b59b-45cf-b270-bc34be522d20 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.297s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-9b6ef8f3-b59b-45cf-b270-bc34be522d20 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e563aebf-1bff-463f-946d-1ba1eaf6d403 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "cinder-quobyte-87c7f669-48d6-42d8-873f-b0ef5e3366e5" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:22 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-9b6ef8f3-b59b-45cf-b270-bc34be522d20 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Deleted volume successfully.
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e563aebf-1bff-463f-946d-1ba1eaf6d403 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-quobyte-87c7f669-48d6-42d8-873f-b0ef5e3366e5" acquired by "delete_volume" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9b6ef8f3-b59b-45cf-b270-bc34be522d20 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-c151ba8e-30e0-422f-8aca-3797b8e91f33-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b09f92f-973c-44cd-afe6-a1871df5333b]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e563aebf-1bff-463f-946d-1ba1eaf6d403 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87c7f669-48d6-42d8-873f-b0ef5e3366e5 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:22 devstack sudo[100801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87c7f669-48d6-42d8-873f-b0ef5e3366e5
Sep 16 16:21:22 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:22 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fbc2350f-92d8-4164-80d1-33174068b120 tempest-ProjectReaderTests-1096202172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a0a9689-c8a3-44b1-a779-f0615ed2439d" returned: 0 in 0.477s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fbc2350f-92d8-4164-80d1-33174068b120 tempest-ProjectReaderTests-1096202172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a0a9689-c8a3-44b1-a779-f0615ed2439d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:22 devstack sudo[100806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a0a9689-c8a3-44b1-a779-f0615ed2439d
Sep 16 16:21:22 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:22 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e563aebf-1bff-463f-946d-1ba1eaf6d403 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87c7f669-48d6-42d8-873f-b0ef5e3366e5" returned: 0 in 0.413s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e563aebf-1bff-463f-946d-1ba1eaf6d403 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87c7f669-48d6-42d8-873f-b0ef5e3366e5 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:22 devstack sudo[100812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87c7f669-48d6-42d8-873f-b0ef5e3366e5
Sep 16 16:21:22 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:22 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fbc2350f-92d8-4164-80d1-33174068b120 tempest-ProjectReaderTests-1096202172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8a0a9689-c8a3-44b1-a779-f0615ed2439d" returned: 0 in 0.276s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fbc2350f-92d8-4164-80d1-33174068b120 tempest-ProjectReaderTests-1096202172 None] Lock "cinder-quobyte-8a0a9689-c8a3-44b1-a779-f0615ed2439d" released by "delete_volume" :: held 0.827s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-fbc2350f-92d8-4164-80d1-33174068b120 tempest-ProjectReaderTests-1096202172 None] Created reservations ['0142402d-b337-4677-99fb-18a5398f5adb', 'a24e5d9b-5172-4636-8d8c-586d91de9703', 'fd295313-06b5-4040-a291-ba8bac44a392', 'e612c88e-1684-4c38-835b-515b1ecc5557'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fbc2350f-92d8-4164-80d1-33174068b120 tempest-ProjectReaderTests-1096202172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fbc2350f-92d8-4164-80d1-33174068b120 tempest-ProjectReaderTests-1096202172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-fbc2350f-92d8-4164-80d1-33174068b120 tempest-ProjectReaderTests-1096202172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-fbc2350f-92d8-4164-80d1-33174068b120 tempest-ProjectReaderTests-1096202172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fbc2350f-92d8-4164-80d1-33174068b120 tempest-ProjectReaderTests-1096202172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fbc2350f-92d8-4164-80d1-33174068b120 tempest-ProjectReaderTests-1096202172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:23 devstack sudo[100815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:21:23 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:23 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e563aebf-1bff-463f-946d-1ba1eaf6d403 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-87c7f669-48d6-42d8-873f-b0ef5e3366e5" returned: 0 in 0.329s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e563aebf-1bff-463f-946d-1ba1eaf6d403 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-quobyte-87c7f669-48d6-42d8-873f-b0ef5e3366e5" released by "delete_volume" :: held 0.799s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-e563aebf-1bff-463f-946d-1ba1eaf6d403 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Created reservations ['e9f1a642-09cc-4d88-9bcb-666161456081', '8c4fac10-255c-4fdb-a1d5-a50c568e0a45', '10fa3d49-ac6e-4a04-bb6c-bc1cfce01064', 'cd6af32d-51e3-4dc3-8ebc-bd5c6aedf226'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e563aebf-1bff-463f-946d-1ba1eaf6d403 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e563aebf-1bff-463f-946d-1ba1eaf6d403 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e563aebf-1bff-463f-946d-1ba1eaf6d403 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:23 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e563aebf-1bff-463f-946d-1ba1eaf6d403 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e563aebf-1bff-463f-946d-1ba1eaf6d403 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e563aebf-1bff-463f-946d-1ba1eaf6d403 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fbc2350f-92d8-4164-80d1-33174068b120 tempest-ProjectReaderTests-1096202172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.407s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-fbc2350f-92d8-4164-80d1-33174068b120 tempest-ProjectReaderTests-1096202172 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:21:23 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-fbc2350f-92d8-4164-80d1-33174068b120 tempest-ProjectReaderTests-1096202172 None] Deleted volume successfully.
Sep 16 16:21:23 devstack sudo[100820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:21:23 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fbc2350f-92d8-4164-80d1-33174068b120 tempest-ProjectReaderTests-1096202172 None] Lock "cinder-8a0a9689-c8a3-44b1-a779-f0615ed2439d-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7762e184-a52f-4bcc-b8f1-87e6ee189c07 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "cinder-cae14d9a-76ba-4763-8a57-41524062308d-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7762e184-a52f-4bcc-b8f1-87e6ee189c07 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-cae14d9a-76ba-4763-8a57-41524062308d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7762e184-a52f-4bcc-b8f1-87e6ee189c07 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "cinder-quobyte-cae14d9a-76ba-4763-8a57-41524062308d" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7762e184-a52f-4bcc-b8f1-87e6ee189c07 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-quobyte-cae14d9a-76ba-4763-8a57-41524062308d" acquired by "delete_volume" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eea5e88-5f3c-483f-a698-045d2a8fde03]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7762e184-a52f-4bcc-b8f1-87e6ee189c07 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cae14d9a-76ba-4763-8a57-41524062308d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:23 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e563aebf-1bff-463f-946d-1ba1eaf6d403 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.359s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-e563aebf-1bff-463f-946d-1ba1eaf6d403 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:21:23 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-e563aebf-1bff-463f-946d-1ba1eaf6d403 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Deleted volume successfully.
Sep 16 16:21:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e563aebf-1bff-463f-946d-1ba1eaf6d403 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-87c7f669-48d6-42d8-873f-b0ef5e3366e5-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:24 devstack sudo[100824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cae14d9a-76ba-4763-8a57-41524062308d
Sep 16 16:21:24 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:24 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7762e184-a52f-4bcc-b8f1-87e6ee189c07 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cae14d9a-76ba-4763-8a57-41524062308d" returned: 0 in 0.478s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7762e184-a52f-4bcc-b8f1-87e6ee189c07 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cae14d9a-76ba-4763-8a57-41524062308d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:24 devstack sudo[100837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cae14d9a-76ba-4763-8a57-41524062308d
Sep 16 16:21:24 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-7a75741a-56ab-4bac-8fa1-0dd2963fb2a6 req-557223a3-8d7a-462d-87b1-e5b8dd14e5b2 tempest-AttachVolumeNegativeTest-909556830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-7a75741a-56ab-4bac-8fa1-0dd2963fb2a6 req-557223a3-8d7a-462d-87b1-e5b8dd14e5b2 tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-7a75741a-56ab-4bac-8fa1-0dd2963fb2a6 req-557223a3-8d7a-462d-87b1-e5b8dd14e5b2 tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:24 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-7a75741a-56ab-4bac-8fa1-0dd2963fb2a6 req-557223a3-8d7a-462d-87b1-e5b8dd14e5b2 tempest-AttachVolumeNegativeTest-909556830 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '169ed395-3c6a-49a1-bbc2-2cc3eba7dcb6', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:21:24 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-7a75741a-56ab-4bac-8fa1-0dd2963fb2a6 req-557223a3-8d7a-462d-87b1-e5b8dd14e5b2 tempest-AttachVolumeNegativeTest-909556830 None] attachment_update completed successfully.
Sep 16 16:21:24 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7762e184-a52f-4bcc-b8f1-87e6ee189c07 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cae14d9a-76ba-4763-8a57-41524062308d" returned: 0 in 0.296s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7762e184-a52f-4bcc-b8f1-87e6ee189c07 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-quobyte-cae14d9a-76ba-4763-8a57-41524062308d" released by "delete_volume" :: held 0.849s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:24 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-7762e184-a52f-4bcc-b8f1-87e6ee189c07 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Created reservations ['f2c45628-1ebd-4ac8-b950-4667cef417ed', '7032c206-b82b-482a-8b7e-f602a657556d', '78d21786-bc4d-473f-8600-55c3a7c3cf3e', 'a0e3b4ca-db70-4168-95db-adc64e61f829'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:21:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7762e184-a52f-4bcc-b8f1-87e6ee189c07 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7762e184-a52f-4bcc-b8f1-87e6ee189c07 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:24 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7762e184-a52f-4bcc-b8f1-87e6ee189c07 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:24 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7762e184-a52f-4bcc-b8f1-87e6ee189c07 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7762e184-a52f-4bcc-b8f1-87e6ee189c07 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7762e184-a52f-4bcc-b8f1-87e6ee189c07 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:24 devstack sudo[100938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:21:24 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7e072c3e-0c9a-4753-bc8f-8756d6131b7b tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "cinder-2d92e620-41fb-48bb-9ddb-a1502fd098fd-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7e072c3e-0c9a-4753-bc8f-8756d6131b7b tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-2d92e620-41fb-48bb-9ddb-a1502fd098fd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:25 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7e072c3e-0c9a-4753-bc8f-8756d6131b7b tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "cinder-quobyte-2d92e620-41fb-48bb-9ddb-a1502fd098fd" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:25 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7e072c3e-0c9a-4753-bc8f-8756d6131b7b tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-quobyte-2d92e620-41fb-48bb-9ddb-a1502fd098fd" acquired by "delete_volume" :: waited 0.022s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:25 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8f2c41-fb64-4891-84fa-1387b292ac3e]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e072c3e-0c9a-4753-bc8f-8756d6131b7b tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d92e620-41fb-48bb-9ddb-a1502fd098fd {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:25 devstack sudo[101254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d92e620-41fb-48bb-9ddb-a1502fd098fd
Sep 16 16:21:25 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:25 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7762e184-a52f-4bcc-b8f1-87e6ee189c07 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.430s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:25 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-7762e184-a52f-4bcc-b8f1-87e6ee189c07 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:21:25 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-7762e184-a52f-4bcc-b8f1-87e6ee189c07 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Deleted volume successfully.
Sep 16 16:21:25 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7762e184-a52f-4bcc-b8f1-87e6ee189c07 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-cae14d9a-76ba-4763-8a57-41524062308d-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:25 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e072c3e-0c9a-4753-bc8f-8756d6131b7b tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d92e620-41fb-48bb-9ddb-a1502fd098fd" returned: 0 in 0.578s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e072c3e-0c9a-4753-bc8f-8756d6131b7b tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d92e620-41fb-48bb-9ddb-a1502fd098fd {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:25 devstack sudo[101264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d92e620-41fb-48bb-9ddb-a1502fd098fd
Sep 16 16:21:25 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:25 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e072c3e-0c9a-4753-bc8f-8756d6131b7b tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2d92e620-41fb-48bb-9ddb-a1502fd098fd" returned: 0 in 0.305s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7e072c3e-0c9a-4753-bc8f-8756d6131b7b tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-quobyte-2d92e620-41fb-48bb-9ddb-a1502fd098fd" released by "delete_volume" :: held 0.940s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:26 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-7e072c3e-0c9a-4753-bc8f-8756d6131b7b tempest-CreateVolumesFromSnapshotTest-1089480911 None] Created reservations ['6ce22652-3a9d-4ad9-90b6-51eae25f6c63', 'e57ac760-5f7c-4128-a9e4-ea01d51a0ed9', '09f364f7-1580-48e7-ad76-c6a15a970235', 'd0257b9c-9a17-4589-aa0b-4c8b303cff19'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:21:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7e072c3e-0c9a-4753-bc8f-8756d6131b7b tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7e072c3e-0c9a-4753-bc8f-8756d6131b7b tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:26 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7e072c3e-0c9a-4753-bc8f-8756d6131b7b tempest-CreateVolumesFromSnapshotTest-1089480911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:26 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7e072c3e-0c9a-4753-bc8f-8756d6131b7b tempest-CreateVolumesFromSnapshotTest-1089480911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7e072c3e-0c9a-4753-bc8f-8756d6131b7b tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e072c3e-0c9a-4753-bc8f-8756d6131b7b tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:26 devstack sudo[101267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:21:26 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:26 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e072c3e-0c9a-4753-bc8f-8756d6131b7b tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.270s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:26 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-7e072c3e-0c9a-4753-bc8f-8756d6131b7b tempest-CreateVolumesFromSnapshotTest-1089480911 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:21:26 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-7e072c3e-0c9a-4753-bc8f-8756d6131b7b tempest-CreateVolumesFromSnapshotTest-1089480911 None] Deleted volume successfully.
Sep 16 16:21:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7e072c3e-0c9a-4753-bc8f-8756d6131b7b tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-2d92e620-41fb-48bb-9ddb-a1502fd098fd-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:27 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-ea4f9df6-36b3-4275-a73a-2181f1083a87 req-f1c6fcc4-9a1f-44cf-b8db-2c74a3ddb80a tempest-AttachVolumeNegativeTest-909556830 None] Terminate volume connection completed successfully.
Sep 16 16:21:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-ea4f9df6-36b3-4275-a73a-2181f1083a87 req-f1c6fcc4-9a1f-44cf-b8db-2c74a3ddb80a tempest-AttachVolumeNegativeTest-909556830 None] Deleting attachment 169ed395-3c6a-49a1-bbc2-2cc3eba7dcb6. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:21:27 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b18beefc-d28b-4719-b52a-d4e8f0c47f8c tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "cinder-cbea5216-f1a7-46f7-aa94-4c27f7db3b36-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:27 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b18beefc-d28b-4719-b52a-d4e8f0c47f8c tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-cbea5216-f1a7-46f7-aa94-4c27f7db3b36-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:27 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b18beefc-d28b-4719-b52a-d4e8f0c47f8c tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "cinder-quobyte-cbea5216-f1a7-46f7-aa94-4c27f7db3b36" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:27 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b18beefc-d28b-4719-b52a-d4e8f0c47f8c tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-quobyte-cbea5216-f1a7-46f7-aa94-4c27f7db3b36" acquired by "delete_volume" :: waited 0.013s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:27 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58a09f6-6414-4aff-a7af-76a126d4ed21]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b18beefc-d28b-4719-b52a-d4e8f0c47f8c tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cbea5216-f1a7-46f7-aa94-4c27f7db3b36 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:27 devstack sudo[101296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cbea5216-f1a7-46f7-aa94-4c27f7db3b36
Sep 16 16:21:27 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:27 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b18beefc-d28b-4719-b52a-d4e8f0c47f8c tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cbea5216-f1a7-46f7-aa94-4c27f7db3b36" returned: 0 in 0.359s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b18beefc-d28b-4719-b52a-d4e8f0c47f8c tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cbea5216-f1a7-46f7-aa94-4c27f7db3b36 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:27 devstack sudo[101301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cbea5216-f1a7-46f7-aa94-4c27f7db3b36
Sep 16 16:21:27 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:27 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b18beefc-d28b-4719-b52a-d4e8f0c47f8c tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cbea5216-f1a7-46f7-aa94-4c27f7db3b36" returned: 0 in 0.247s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:27 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b18beefc-d28b-4719-b52a-d4e8f0c47f8c tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-quobyte-cbea5216-f1a7-46f7-aa94-4c27f7db3b36" released by "delete_volume" :: held 0.647s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:27 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-b18beefc-d28b-4719-b52a-d4e8f0c47f8c tempest-CreateVolumesFromSnapshotTest-1089480911 None] Created reservations ['4524e9c4-1aa8-4f9e-9d69-22130d22601e', '606d51df-7a7f-4b7e-9cb3-601b4b837d9d', '5c33b154-7ac4-41fa-af1b-6baff786e178', 'aa409838-918a-485c-841c-5412112401f2'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:21:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b18beefc-d28b-4719-b52a-d4e8f0c47f8c tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b18beefc-d28b-4719-b52a-d4e8f0c47f8c tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:28 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b18beefc-d28b-4719-b52a-d4e8f0c47f8c tempest-CreateVolumesFromSnapshotTest-1089480911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:28 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b18beefc-d28b-4719-b52a-d4e8f0c47f8c tempest-CreateVolumesFromSnapshotTest-1089480911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b18beefc-d28b-4719-b52a-d4e8f0c47f8c tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b18beefc-d28b-4719-b52a-d4e8f0c47f8c tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:28 devstack sudo[101304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:21:28 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7e52b5b0-fc15-48d2-8cc7-10b3d348c612 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "cinder-ecd638e2-f01b-4d6d-9303-ceec64664b64-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7e52b5b0-fc15-48d2-8cc7-10b3d348c612 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-ecd638e2-f01b-4d6d-9303-ceec64664b64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7e52b5b0-fc15-48d2-8cc7-10b3d348c612 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "cinder-quobyte-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7e52b5b0-fc15-48d2-8cc7-10b3d348c612 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-quobyte-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7e52b5b0-fc15-48d2-8cc7-10b3d348c612 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "cinder-quobyte-ecd638e2-f01b-4d6d-9303-ceec64664b64" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:28 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7e52b5b0-fc15-48d2-8cc7-10b3d348c612 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-quobyte-ecd638e2-f01b-4d6d-9303-ceec64664b64" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:28 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-7e52b5b0-fc15-48d2-8cc7-10b3d348c612 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Deleting offline snapshot ecd638e2-f01b-4d6d-9303-ceec64664b64 of volume 2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:21:28 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-7e52b5b0-fc15-48d2-8cc7-10b3d348c612 tempest-CreateVolumesFromSnapshotTest-1089480911 None] snapshot_file for this snap is: volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.ecd638e2-f01b-4d6d-9303-ceec64664b64 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:21:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b18beefc-d28b-4719-b52a-d4e8f0c47f8c tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.474s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:28 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-b18beefc-d28b-4719-b52a-d4e8f0c47f8c tempest-CreateVolumesFromSnapshotTest-1089480911 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:21:28 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b18beefc-d28b-4719-b52a-d4e8f0c47f8c tempest-CreateVolumesFromSnapshotTest-1089480911 None] Deleted volume successfully.
Sep 16 16:21:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b18beefc-d28b-4719-b52a-d4e8f0c47f8c tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-cbea5216-f1a7-46f7-aa94-4c27f7db3b36-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:28 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd136b6e-5170-43c4-b4d0-41a69ca7bd69]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e52b5b0-fc15-48d2-8cc7-10b3d348c612 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.ecd638e2-f01b-4d6d-9303-ceec64664b64 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:28 devstack sudo[101324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.ecd638e2-f01b-4d6d-9303-ceec64664b64
Sep 16 16:21:28 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:29 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e52b5b0-fc15-48d2-8cc7-10b3d348c612 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.ecd638e2-f01b-4d6d-9303-ceec64664b64" returned: 0 in 0.422s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-7e52b5b0-fc15-48d2-8cc7-10b3d348c612 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:21:29 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0091309b-42a8-49b8-8d19-6a6d51f98383]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e52b5b0-fc15-48d2-8cc7-10b3d348c612 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:29 devstack sudo[101335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3
Sep 16 16:21:29 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:29 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e52b5b0-fc15-48d2-8cc7-10b3d348c612 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3" returned: 0 in 0.388s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e52b5b0-fc15-48d2-8cc7-10b3d348c612 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.ecd638e2-f01b-4d6d-9303-ceec64664b64 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:29 devstack sudo[101341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.ecd638e2-f01b-4d6d-9303-ceec64664b64
Sep 16 16:21:29 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:29 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e52b5b0-fc15-48d2-8cc7-10b3d348c612 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.ecd638e2-f01b-4d6d-9303-ceec64664b64" returned: 0 in 0.383s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e52b5b0-fc15-48d2-8cc7-10b3d348c612 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.ecd638e2-f01b-4d6d-9303-ceec64664b64 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:29 devstack sudo[101346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.ecd638e2-f01b-4d6d-9303-ceec64664b64
Sep 16 16:21:29 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:30 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e52b5b0-fc15-48d2-8cc7-10b3d348c612 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3.ecd638e2-f01b-4d6d-9303-ceec64664b64" returned: 0 in 0.249s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7e52b5b0-fc15-48d2-8cc7-10b3d348c612 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-quobyte-ecd638e2-f01b-4d6d-9303-ceec64664b64" released by "_delete_snapshot" :: held 1.700s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7e52b5b0-fc15-48d2-8cc7-10b3d348c612 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-quobyte-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3" released by "delete_snapshot" :: held 1.742s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:30 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-7e52b5b0-fc15-48d2-8cc7-10b3d348c612 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Created reservations ['c5ce0c23-94e3-4e93-96ab-535ea1b8c82a', 'e6a1820b-2092-4029-9e1c-91e955321297', '98b7e215-dd04-4372-b487-106c30736369', 'fe914a80-4e74-4375-8ff1-bfad35d99e13'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:21:30 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-7e52b5b0-fc15-48d2-8cc7-10b3d348c612 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Delete snapshot completed successfully.
Sep 16 16:21:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7e52b5b0-fc15-48d2-8cc7-10b3d348c612 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-ecd638e2-f01b-4d6d-9303-ceec64664b64-delete_snapshot" released by "delete_snapshot" :: held 1.936s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-944055ea-3694-41b8-bbfc-a6f9428393c4 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "cinder-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-944055ea-3694-41b8-bbfc-a6f9428393c4 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-944055ea-3694-41b8-bbfc-a6f9428393c4 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "cinder-quobyte-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-944055ea-3694-41b8-bbfc-a6f9428393c4 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-quobyte-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3" acquired by "delete_volume" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:30 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0b1546-06d3-49aa-8bdf-c3d0e8c290ce]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-944055ea-3694-41b8-bbfc-a6f9428393c4 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:30 devstack sudo[101352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3
Sep 16 16:21:30 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:31 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-944055ea-3694-41b8-bbfc-a6f9428393c4 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3" returned: 0 in 0.388s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-944055ea-3694-41b8-bbfc-a6f9428393c4 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:31 devstack sudo[101357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3
Sep 16 16:21:31 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:31 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-944055ea-3694-41b8-bbfc-a6f9428393c4 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3" returned: 0 in 0.245s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-944055ea-3694-41b8-bbfc-a6f9428393c4 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-quobyte-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3" released by "delete_volume" :: held 0.711s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:31 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-944055ea-3694-41b8-bbfc-a6f9428393c4 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Created reservations ['c35eee86-11bf-4d0a-ac58-62cde26935cc', 'c50dd45a-9c6c-47b1-a67f-de821492cd29', 'e87d43ea-96fc-42ac-bab8-5c0e9edaa8d0', '95dd455c-9229-4e94-9d4b-a427eb23bbdf'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:21:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-944055ea-3694-41b8-bbfc-a6f9428393c4 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-944055ea-3694-41b8-bbfc-a6f9428393c4 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-944055ea-3694-41b8-bbfc-a6f9428393c4 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-944055ea-3694-41b8-bbfc-a6f9428393c4 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-944055ea-3694-41b8-bbfc-a6f9428393c4 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-944055ea-3694-41b8-bbfc-a6f9428393c4 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:31 devstack sudo[101360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:21:31 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:31 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-944055ea-3694-41b8-bbfc-a6f9428393c4 tempest-CreateVolumesFromSnapshotTest-1089480911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.253s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:31 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-944055ea-3694-41b8-bbfc-a6f9428393c4 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:21:31 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-944055ea-3694-41b8-bbfc-a6f9428393c4 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Deleted volume successfully.
Sep 16 16:21:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-944055ea-3694-41b8-bbfc-a6f9428393c4 tempest-CreateVolumesFromSnapshotTest-1089480911 None] Lock "cinder-2ee3d7e9-65de-4f5e-b7a7-3549a53a0ce3-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d2923947-7d17-489e-815c-4a5d7e58efa8 tempest-AttachVolumeNegativeTest-909556830 None] Acquiring lock "cinder-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d2923947-7d17-489e-815c-4a5d7e58efa8 tempest-AttachVolumeNegativeTest-909556830 None] Lock "cinder-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d2923947-7d17-489e-815c-4a5d7e58efa8 tempest-AttachVolumeNegativeTest-909556830 None] Acquiring lock "cinder-quobyte-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d2923947-7d17-489e-815c-4a5d7e58efa8 tempest-AttachVolumeNegativeTest-909556830 None] Lock "cinder-quobyte-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c" acquired by "delete_volume" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:33 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9301247f-952f-4cf0-ad4e-f74597a2b890]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d2923947-7d17-489e-815c-4a5d7e58efa8 tempest-AttachVolumeNegativeTest-909556830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:33 devstack sudo[101363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c
Sep 16 16:21:33 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:33 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d2923947-7d17-489e-815c-4a5d7e58efa8 tempest-AttachVolumeNegativeTest-909556830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c" returned: 0 in 0.370s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d2923947-7d17-489e-815c-4a5d7e58efa8 tempest-AttachVolumeNegativeTest-909556830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:33 devstack sudo[101368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c
Sep 16 16:21:33 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:33 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d2923947-7d17-489e-815c-4a5d7e58efa8 tempest-AttachVolumeNegativeTest-909556830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c" returned: 0 in 0.276s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d2923947-7d17-489e-815c-4a5d7e58efa8 tempest-AttachVolumeNegativeTest-909556830 None] Lock "cinder-quobyte-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c" released by "delete_volume" :: held 0.704s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:33 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-d2923947-7d17-489e-815c-4a5d7e58efa8 tempest-AttachVolumeNegativeTest-909556830 None] Created reservations ['82f032ae-474b-427e-9f31-17944db78d52', 'b0273c23-3ac6-4b2b-95d3-89d14b473910', '8984725e-539e-4f04-9c14-dc011df64046', '380d8902-a512-49b6-bc44-f51228767ddb'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:21:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d2923947-7d17-489e-815c-4a5d7e58efa8 tempest-AttachVolumeNegativeTest-909556830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d2923947-7d17-489e-815c-4a5d7e58efa8 tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d2923947-7d17-489e-815c-4a5d7e58efa8 tempest-AttachVolumeNegativeTest-909556830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d2923947-7d17-489e-815c-4a5d7e58efa8 tempest-AttachVolumeNegativeTest-909556830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d2923947-7d17-489e-815c-4a5d7e58efa8 tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d2923947-7d17-489e-815c-4a5d7e58efa8 tempest-AttachVolumeNegativeTest-909556830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:33 devstack sudo[101371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:21:33 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:34 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d2923947-7d17-489e-815c-4a5d7e58efa8 tempest-AttachVolumeNegativeTest-909556830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.344s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:34 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-d2923947-7d17-489e-815c-4a5d7e58efa8 tempest-AttachVolumeNegativeTest-909556830 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:21:34 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-d2923947-7d17-489e-815c-4a5d7e58efa8 tempest-AttachVolumeNegativeTest-909556830 None] Deleted volume successfully.
Sep 16 16:21:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d2923947-7d17-489e-815c-4a5d7e58efa8 tempest-AttachVolumeNegativeTest-909556830 None] Lock "cinder-a52cffb2-d50c-40f0-94e5-c2b16ceaaf2c-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9363bf4c-8159-4181-a9e8-e027a78a6584 tempest-AttachVolumeNegativeTest-909556830 None] Acquiring lock "cinder-31bfd240-014a-4be1-afbd-bb3357b1fda3-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9363bf4c-8159-4181-a9e8-e027a78a6584 tempest-AttachVolumeNegativeTest-909556830 None] Lock "cinder-31bfd240-014a-4be1-afbd-bb3357b1fda3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9363bf4c-8159-4181-a9e8-e027a78a6584 tempest-AttachVolumeNegativeTest-909556830 None] Acquiring lock "cinder-quobyte-31bfd240-014a-4be1-afbd-bb3357b1fda3" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9363bf4c-8159-4181-a9e8-e027a78a6584 tempest-AttachVolumeNegativeTest-909556830 None] Lock "cinder-quobyte-31bfd240-014a-4be1-afbd-bb3357b1fda3" acquired by "delete_volume" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:34 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a6c2f4-f383-4b19-bac0-96f473207460]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9363bf4c-8159-4181-a9e8-e027a78a6584 tempest-AttachVolumeNegativeTest-909556830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-31bfd240-014a-4be1-afbd-bb3357b1fda3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:34 devstack sudo[101374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-31bfd240-014a-4be1-afbd-bb3357b1fda3
Sep 16 16:21:34 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:34 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9363bf4c-8159-4181-a9e8-e027a78a6584 tempest-AttachVolumeNegativeTest-909556830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-31bfd240-014a-4be1-afbd-bb3357b1fda3" returned: 0 in 0.452s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9363bf4c-8159-4181-a9e8-e027a78a6584 tempest-AttachVolumeNegativeTest-909556830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-31bfd240-014a-4be1-afbd-bb3357b1fda3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:34 devstack sudo[101379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-31bfd240-014a-4be1-afbd-bb3357b1fda3
Sep 16 16:21:34 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:35 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9363bf4c-8159-4181-a9e8-e027a78a6584 tempest-AttachVolumeNegativeTest-909556830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-31bfd240-014a-4be1-afbd-bb3357b1fda3" returned: 0 in 0.273s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9363bf4c-8159-4181-a9e8-e027a78a6584 tempest-AttachVolumeNegativeTest-909556830 None] Lock "cinder-quobyte-31bfd240-014a-4be1-afbd-bb3357b1fda3" released by "delete_volume" :: held 0.773s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:35 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-9363bf4c-8159-4181-a9e8-e027a78a6584 tempest-AttachVolumeNegativeTest-909556830 None] Created reservations ['2c839ad6-48a8-43d9-b97e-b8105c5de530', '6a5b9cde-fbc2-4756-a102-f5fc6b09603a', 'cbf3b301-d362-4821-bddd-845c8930be5c', '952c38af-d976-4876-bcab-f635ae10715e'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:21:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9363bf4c-8159-4181-a9e8-e027a78a6584 tempest-AttachVolumeNegativeTest-909556830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9363bf4c-8159-4181-a9e8-e027a78a6584 tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9363bf4c-8159-4181-a9e8-e027a78a6584 tempest-AttachVolumeNegativeTest-909556830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9363bf4c-8159-4181-a9e8-e027a78a6584 tempest-AttachVolumeNegativeTest-909556830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9363bf4c-8159-4181-a9e8-e027a78a6584 tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9363bf4c-8159-4181-a9e8-e027a78a6584 tempest-AttachVolumeNegativeTest-909556830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:35 devstack sudo[101382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:21:35 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:35 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9363bf4c-8159-4181-a9e8-e027a78a6584 tempest-AttachVolumeNegativeTest-909556830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.329s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:35 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-9363bf4c-8159-4181-a9e8-e027a78a6584 tempest-AttachVolumeNegativeTest-909556830 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:21:35 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-9363bf4c-8159-4181-a9e8-e027a78a6584 tempest-AttachVolumeNegativeTest-909556830 None] Deleted volume successfully.
Sep 16 16:21:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9363bf4c-8159-4181-a9e8-e027a78a6584 tempest-AttachVolumeNegativeTest-909556830 None] Lock "cinder-31bfd240-014a-4be1-afbd-bb3357b1fda3-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-649dab53-7125-4e85-b203-aff157221781 tempest-AttachVolumeNegativeTest-909556830 None] Acquiring lock "cinder-b1804a44-8b50-41d9-890a-f546bc30b9eb-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-649dab53-7125-4e85-b203-aff157221781 tempest-AttachVolumeNegativeTest-909556830 None] Lock "cinder-b1804a44-8b50-41d9-890a-f546bc30b9eb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-649dab53-7125-4e85-b203-aff157221781 tempest-AttachVolumeNegativeTest-909556830 None] Acquiring lock "cinder-quobyte-b1804a44-8b50-41d9-890a-f546bc30b9eb" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-649dab53-7125-4e85-b203-aff157221781 tempest-AttachVolumeNegativeTest-909556830 None] Lock "cinder-quobyte-b1804a44-8b50-41d9-890a-f546bc30b9eb" acquired by "delete_volume" :: waited 0.018s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:35 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0bb1d9-cc3b-48e5-8bbd-4831bc15e6ac]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-649dab53-7125-4e85-b203-aff157221781 tempest-AttachVolumeNegativeTest-909556830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b1804a44-8b50-41d9-890a-f546bc30b9eb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:36 devstack sudo[101385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b1804a44-8b50-41d9-890a-f546bc30b9eb
Sep 16 16:21:36 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:36 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-649dab53-7125-4e85-b203-aff157221781 tempest-AttachVolumeNegativeTest-909556830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b1804a44-8b50-41d9-890a-f546bc30b9eb" returned: 0 in 0.418s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-649dab53-7125-4e85-b203-aff157221781 tempest-AttachVolumeNegativeTest-909556830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b1804a44-8b50-41d9-890a-f546bc30b9eb {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:36 devstack sudo[101390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b1804a44-8b50-41d9-890a-f546bc30b9eb
Sep 16 16:21:36 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:36 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-649dab53-7125-4e85-b203-aff157221781 tempest-AttachVolumeNegativeTest-909556830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b1804a44-8b50-41d9-890a-f546bc30b9eb" returned: 0 in 0.336s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:36 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-649dab53-7125-4e85-b203-aff157221781 tempest-AttachVolumeNegativeTest-909556830 None] Lock "cinder-quobyte-b1804a44-8b50-41d9-890a-f546bc30b9eb" released by "delete_volume" :: held 0.806s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:36 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-649dab53-7125-4e85-b203-aff157221781 tempest-AttachVolumeNegativeTest-909556830 None] Created reservations ['3bfd5992-92b2-4c2e-8d15-8d55a53dba0c', '767946a7-030d-496e-9646-9836e4039b45', 'f603fe98-bfdf-44d9-a1c1-49ca18c23e14', '8c8d68ab-0260-4cb7-acf0-d424a093ae46'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:21:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-649dab53-7125-4e85-b203-aff157221781 tempest-AttachVolumeNegativeTest-909556830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-649dab53-7125-4e85-b203-aff157221781 tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-649dab53-7125-4e85-b203-aff157221781 tempest-AttachVolumeNegativeTest-909556830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-649dab53-7125-4e85-b203-aff157221781 tempest-AttachVolumeNegativeTest-909556830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-649dab53-7125-4e85-b203-aff157221781 tempest-AttachVolumeNegativeTest-909556830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-649dab53-7125-4e85-b203-aff157221781 tempest-AttachVolumeNegativeTest-909556830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:36 devstack sudo[101393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:21:36 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:37 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-649dab53-7125-4e85-b203-aff157221781 tempest-AttachVolumeNegativeTest-909556830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.274s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:37 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-649dab53-7125-4e85-b203-aff157221781 tempest-AttachVolumeNegativeTest-909556830 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:21:37 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-649dab53-7125-4e85-b203-aff157221781 tempest-AttachVolumeNegativeTest-909556830 None] Deleted volume successfully.
Sep 16 16:21:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-649dab53-7125-4e85-b203-aff157221781 tempest-AttachVolumeNegativeTest-909556830 None] Lock "cinder-b1804a44-8b50-41d9-890a-f546bc30b9eb-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:45 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:21:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Flow 'volume_create_manager' (66dd08cb-8657-4750-bd52-3e127cb1f639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc4cb27-9035-4866-8b28-de96c1f9cdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc4cb27-9035-4866-8b28-de96c1f9cdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1481554115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b2c7da-b8fa-4f05-a426-9419ea0ae389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426a6b21fbc8460f937dd24900448c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:45Z,use_quota=True,user_id='a43c922638bd43c2a8c269b07231ff09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67aa574f-be6a-4645-8869-25f09074c8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67aa574f-be6a-4645-8869-25f09074c8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3490773-bde7-452b-945d-3220f6093d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3490773-bde7-452b-945d-3220f6093d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33b2c7da-b8fa-4f05-a426-9419ea0ae389', 'volume_name': 'volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85e6ffc-8eeb-4ff0-9469-b8b59f684371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85e6ffc-8eeb-4ff0-9469-b8b59f684371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:45 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f90440-f094-417e-81cf-6240d7420917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:45 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Volume 33b2c7da-b8fa-4f05-a426-9419ea0ae389: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389', 'volume_size': 1}
Sep 16 16:21:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1481554115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b2c7da-b8fa-4f05-a426-9419ea0ae389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='426a6b21fbc8460f937dd24900448c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:45Z,use_quota=True,user_id='a43c922638bd43c2a8c269b07231ff09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:21:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Creating volume 33b2c7da-b8fa-4f05-a426-9419ea0ae389 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:21:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:45 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:21:45 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:21:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:45 devstack sudo[101402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389 1073741824
Sep 16 16:21:45 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:46 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389 1073741824" returned: 0 in 0.520s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:46 devstack sudo[101408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389
Sep 16 16:21:46 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:46 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389" returned: 0 in 0.274s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:46 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:21:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f90440-f094-417e-81cf-6240d7420917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2676aca2-6850-4bb2-9740-0e24357978cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:46 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Volume volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389 (33b2c7da-b8fa-4f05-a426-9419ea0ae389): created successfully
Sep 16 16:21:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2676aca2-6850-4bb2-9740-0e24357978cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Flow 'volume_create_manager' (66dd08cb-8657-4750-bd52-3e127cb1f639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:46 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-0d038e70-70e7-4f04-922e-18311f384ee3 req-27fcc954-de7f-4c92-b564-9e02e6bd43c8 tempest-VolumesSnapshotsTestJSON-315939754 None] Created volume successfully.
Sep 16 16:21:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-353bb3cd-4b8e-42af-b915-fbfb14d86ad1 req-37835ed2-966e-4ae0-8f1a-da4134abf700 tempest-VolumesSnapshotsTestJSON-315939754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-353bb3cd-4b8e-42af-b915-fbfb14d86ad1 req-37835ed2-966e-4ae0-8f1a-da4134abf700 tempest-VolumesSnapshotsTestJSON-315939754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [req-353bb3cd-4b8e-42af-b915-fbfb14d86ad1 req-37835ed2-966e-4ae0-8f1a-da4134abf700 tempest-VolumesSnapshotsTestJSON-315939754 None] Creating offline snapshot 53d471e4-81b0-4051-a455-3d45b1d01f51 of volume 33b2c7da-b8fa-4f05-a426-9419ea0ae389 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:21:47 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa199bd-c5c8-458f-8fff-060d61df96f1]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-353bb3cd-4b8e-42af-b915-fbfb14d86ad1 req-37835ed2-966e-4ae0-8f1a-da4134abf700 tempest-VolumesSnapshotsTestJSON-315939754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:48 devstack sudo[101411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389
Sep 16 16:21:48 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:48 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-353bb3cd-4b8e-42af-b915-fbfb14d86ad1 req-37835ed2-966e-4ae0-8f1a-da4134abf700 tempest-VolumesSnapshotsTestJSON-315939754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389" returned: 0 in 0.485s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-353bb3cd-4b8e-42af-b915-fbfb14d86ad1 req-37835ed2-966e-4ae0-8f1a-da4134abf700 tempest-VolumesSnapshotsTestJSON-315939754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.53d471e4-81b0-4051-a455-3d45b1d01f51 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:48 devstack sudo[101416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.53d471e4-81b0-4051-a455-3d45b1d01f51 1G
Sep 16 16:21:48 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:48 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-353bb3cd-4b8e-42af-b915-fbfb14d86ad1 req-37835ed2-966e-4ae0-8f1a-da4134abf700 tempest-VolumesSnapshotsTestJSON-315939754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.53d471e4-81b0-4051-a455-3d45b1d01f51 1G" returned: 0 in 0.501s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-353bb3cd-4b8e-42af-b915-fbfb14d86ad1 req-37835ed2-966e-4ae0-8f1a-da4134abf700 tempest-VolumesSnapshotsTestJSON-315939754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.53d471e4-81b0-4051-a455-3d45b1d01f51 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:49 devstack sudo[101422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.53d471e4-81b0-4051-a455-3d45b1d01f51
Sep 16 16:21:49 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:49 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-353bb3cd-4b8e-42af-b915-fbfb14d86ad1 req-37835ed2-966e-4ae0-8f1a-da4134abf700 tempest-VolumesSnapshotsTestJSON-315939754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.53d471e4-81b0-4051-a455-3d45b1d01f51" returned: 0 in 0.353s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:49 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [req-353bb3cd-4b8e-42af-b915-fbfb14d86ad1 req-37835ed2-966e-4ae0-8f1a-da4134abf700 tempest-VolumesSnapshotsTestJSON-315939754 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.53d471e4-81b0-4051-a455-3d45b1d01f51 is being set with open permissions: ugo+rw
Sep 16 16:21:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-353bb3cd-4b8e-42af-b915-fbfb14d86ad1 req-37835ed2-966e-4ae0-8f1a-da4134abf700 tempest-VolumesSnapshotsTestJSON-315939754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.53d471e4-81b0-4051-a455-3d45b1d01f51 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:49 devstack sudo[101427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.53d471e4-81b0-4051-a455-3d45b1d01f51
Sep 16 16:21:49 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:49 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-353bb3cd-4b8e-42af-b915-fbfb14d86ad1 req-37835ed2-966e-4ae0-8f1a-da4134abf700 tempest-VolumesSnapshotsTestJSON-315939754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.53d471e4-81b0-4051-a455-3d45b1d01f51" returned: 0 in 0.276s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-353bb3cd-4b8e-42af-b915-fbfb14d86ad1 req-37835ed2-966e-4ae0-8f1a-da4134abf700 tempest-VolumesSnapshotsTestJSON-315939754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:49 devstack sudo[101430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.info
Sep 16 16:21:49 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:49 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-353bb3cd-4b8e-42af-b915-fbfb14d86ad1 req-37835ed2-966e-4ae0-8f1a-da4134abf700 tempest-VolumesSnapshotsTestJSON-315939754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.info" returned: 0 in 0.254s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:49 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [req-353bb3cd-4b8e-42af-b915-fbfb14d86ad1 req-37835ed2-966e-4ae0-8f1a-da4134abf700 tempest-VolumesSnapshotsTestJSON-315939754 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.info is being set with open permissions: ugo+rw
Sep 16 16:21:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-353bb3cd-4b8e-42af-b915-fbfb14d86ad1 req-37835ed2-966e-4ae0-8f1a-da4134abf700 tempest-VolumesSnapshotsTestJSON-315939754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:49 devstack sudo[101433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.info
Sep 16 16:21:49 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:50 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-353bb3cd-4b8e-42af-b915-fbfb14d86ad1 req-37835ed2-966e-4ae0-8f1a-da4134abf700 tempest-VolumesSnapshotsTestJSON-315939754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.info" returned: 0 in 0.260s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-353bb3cd-4b8e-42af-b915-fbfb14d86ad1 req-37835ed2-966e-4ae0-8f1a-da4134abf700 tempest-VolumesSnapshotsTestJSON-315939754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.241s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:50 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-353bb3cd-4b8e-42af-b915-fbfb14d86ad1 req-37835ed2-966e-4ae0-8f1a-da4134abf700 tempest-VolumesSnapshotsTestJSON-315939754 None] Create snapshot completed successfully
Sep 16 16:21:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-42eb6df6-4cee-448b-9c6a-772d3f981456 req-63e83c30-8343-4c40-8a2e-cbed27cf07ba tempest-VolumesSnapshotsTestJSON-315939754 None] Acquiring lock "cinder-53d471e4-81b0-4051-a455-3d45b1d01f51-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-42eb6df6-4cee-448b-9c6a-772d3f981456 req-63e83c30-8343-4c40-8a2e-cbed27cf07ba tempest-VolumesSnapshotsTestJSON-315939754 None] Lock "cinder-53d471e4-81b0-4051-a455-3d45b1d01f51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-42eb6df6-4cee-448b-9c6a-772d3f981456 req-63e83c30-8343-4c40-8a2e-cbed27cf07ba tempest-VolumesSnapshotsTestJSON-315939754 None] Acquiring lock "cinder-quobyte-33b2c7da-b8fa-4f05-a426-9419ea0ae389" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-42eb6df6-4cee-448b-9c6a-772d3f981456 req-63e83c30-8343-4c40-8a2e-cbed27cf07ba tempest-VolumesSnapshotsTestJSON-315939754 None] Lock "cinder-quobyte-33b2c7da-b8fa-4f05-a426-9419ea0ae389" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-42eb6df6-4cee-448b-9c6a-772d3f981456 req-63e83c30-8343-4c40-8a2e-cbed27cf07ba tempest-VolumesSnapshotsTestJSON-315939754 None] Acquiring lock "cinder-quobyte-53d471e4-81b0-4051-a455-3d45b1d01f51" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-42eb6df6-4cee-448b-9c6a-772d3f981456 req-63e83c30-8343-4c40-8a2e-cbed27cf07ba tempest-VolumesSnapshotsTestJSON-315939754 None] Lock "cinder-quobyte-53d471e4-81b0-4051-a455-3d45b1d01f51" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:50 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [req-42eb6df6-4cee-448b-9c6a-772d3f981456 req-63e83c30-8343-4c40-8a2e-cbed27cf07ba tempest-VolumesSnapshotsTestJSON-315939754 None] Deleting offline snapshot 53d471e4-81b0-4051-a455-3d45b1d01f51 of volume 33b2c7da-b8fa-4f05-a426-9419ea0ae389 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:21:50 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [req-42eb6df6-4cee-448b-9c6a-772d3f981456 req-63e83c30-8343-4c40-8a2e-cbed27cf07ba tempest-VolumesSnapshotsTestJSON-315939754 None] snapshot_file for this snap is: volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.53d471e4-81b0-4051-a455-3d45b1d01f51 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:21:50 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4836e3-7a0b-4c5d-b3e2-b0d7365b7cdd]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-42eb6df6-4cee-448b-9c6a-772d3f981456 req-63e83c30-8343-4c40-8a2e-cbed27cf07ba tempest-VolumesSnapshotsTestJSON-315939754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.53d471e4-81b0-4051-a455-3d45b1d01f51 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:50 devstack sudo[101437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.53d471e4-81b0-4051-a455-3d45b1d01f51
Sep 16 16:21:50 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:51 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-42eb6df6-4cee-448b-9c6a-772d3f981456 req-63e83c30-8343-4c40-8a2e-cbed27cf07ba tempest-VolumesSnapshotsTestJSON-315939754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.53d471e4-81b0-4051-a455-3d45b1d01f51" returned: 0 in 0.359s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [req-42eb6df6-4cee-448b-9c6a-772d3f981456 req-63e83c30-8343-4c40-8a2e-cbed27cf07ba tempest-VolumesSnapshotsTestJSON-315939754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:21:51 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb500b48-0dcd-4ec0-99a0-7aeccbaddf17]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-42eb6df6-4cee-448b-9c6a-772d3f981456 req-63e83c30-8343-4c40-8a2e-cbed27cf07ba tempest-VolumesSnapshotsTestJSON-315939754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:51 devstack sudo[101442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389
Sep 16 16:21:51 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:51 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-42eb6df6-4cee-448b-9c6a-772d3f981456 req-63e83c30-8343-4c40-8a2e-cbed27cf07ba tempest-VolumesSnapshotsTestJSON-315939754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389" returned: 0 in 0.699s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-42eb6df6-4cee-448b-9c6a-772d3f981456 req-63e83c30-8343-4c40-8a2e-cbed27cf07ba tempest-VolumesSnapshotsTestJSON-315939754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.53d471e4-81b0-4051-a455-3d45b1d01f51 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:51 devstack sudo[101449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.53d471e4-81b0-4051-a455-3d45b1d01f51
Sep 16 16:21:51 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:52 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-42eb6df6-4cee-448b-9c6a-772d3f981456 req-63e83c30-8343-4c40-8a2e-cbed27cf07ba tempest-VolumesSnapshotsTestJSON-315939754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.53d471e4-81b0-4051-a455-3d45b1d01f51" returned: 0 in 0.369s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-42eb6df6-4cee-448b-9c6a-772d3f981456 req-63e83c30-8343-4c40-8a2e-cbed27cf07ba tempest-VolumesSnapshotsTestJSON-315939754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.53d471e4-81b0-4051-a455-3d45b1d01f51 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:52 devstack sudo[101454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.53d471e4-81b0-4051-a455-3d45b1d01f51
Sep 16 16:21:52 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:52 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-42eb6df6-4cee-448b-9c6a-772d3f981456 req-63e83c30-8343-4c40-8a2e-cbed27cf07ba tempest-VolumesSnapshotsTestJSON-315939754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389.53d471e4-81b0-4051-a455-3d45b1d01f51" returned: 0 in 0.258s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:52 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=195,cinder:SELECT=164,cinder:INSERT=48,cinder:DELETE=15 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:21:52 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=126,cinder:UPDATE=215,cinder:DELETE=22,cinder:INSERT=47 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:21:52 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-42eb6df6-4cee-448b-9c6a-772d3f981456 req-63e83c30-8343-4c40-8a2e-cbed27cf07ba tempest-VolumesSnapshotsTestJSON-315939754 None] Lock "cinder-quobyte-53d471e4-81b0-4051-a455-3d45b1d01f51" released by "_delete_snapshot" :: held 1.831s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:52 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-42eb6df6-4cee-448b-9c6a-772d3f981456 req-63e83c30-8343-4c40-8a2e-cbed27cf07ba tempest-VolumesSnapshotsTestJSON-315939754 None] Lock "cinder-quobyte-33b2c7da-b8fa-4f05-a426-9419ea0ae389" released by "delete_snapshot" :: held 1.861s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:52 devstack cinder-volume[86165]: DEBUG cinder.quota [req-42eb6df6-4cee-448b-9c6a-772d3f981456 req-63e83c30-8343-4c40-8a2e-cbed27cf07ba tempest-VolumesSnapshotsTestJSON-315939754 None] Created reservations ['e7a2b99d-5438-48c8-b6d8-ebff4d49fc0d', '58ea8a76-22ec-4f58-9984-c4df29f60260', '5ab87a33-0ad1-4177-925f-2b362508ae4d', 'ea3877f1-fb8c-4528-98b9-7c27d5372f02'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:21:52 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-42eb6df6-4cee-448b-9c6a-772d3f981456 req-63e83c30-8343-4c40-8a2e-cbed27cf07ba tempest-VolumesSnapshotsTestJSON-315939754 None] Delete snapshot completed successfully.
Sep 16 16:21:52 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-42eb6df6-4cee-448b-9c6a-772d3f981456 req-63e83c30-8343-4c40-8a2e-cbed27cf07ba tempest-VolumesSnapshotsTestJSON-315939754 None] Lock "cinder-53d471e4-81b0-4051-a455-3d45b1d01f51-delete_snapshot" released by "delete_snapshot" :: held 2.007s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-e2357f65-c504-46af-9763-add4c00484b7 req-b7d18a9f-2f56-4ef4-8054-7de757b0fd11 tempest-VolumesSnapshotsTestJSON-315939754 None] Acquiring lock "cinder-33b2c7da-b8fa-4f05-a426-9419ea0ae389-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-e2357f65-c504-46af-9763-add4c00484b7 req-b7d18a9f-2f56-4ef4-8054-7de757b0fd11 tempest-VolumesSnapshotsTestJSON-315939754 None] Lock "cinder-33b2c7da-b8fa-4f05-a426-9419ea0ae389-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-e2357f65-c504-46af-9763-add4c00484b7 req-b7d18a9f-2f56-4ef4-8054-7de757b0fd11 tempest-VolumesSnapshotsTestJSON-315939754 None] Acquiring lock "cinder-quobyte-33b2c7da-b8fa-4f05-a426-9419ea0ae389" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-e2357f65-c504-46af-9763-add4c00484b7 req-b7d18a9f-2f56-4ef4-8054-7de757b0fd11 tempest-VolumesSnapshotsTestJSON-315939754 None] Lock "cinder-quobyte-33b2c7da-b8fa-4f05-a426-9419ea0ae389" acquired by "delete_volume" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:53 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[930f5456-68ad-404a-a393-7cba30a8bb19]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:21:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-e2357f65-c504-46af-9763-add4c00484b7 req-b7d18a9f-2f56-4ef4-8054-7de757b0fd11 tempest-VolumesSnapshotsTestJSON-315939754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:53 devstack sudo[101457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389
Sep 16 16:21:53 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:53 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-e2357f65-c504-46af-9763-add4c00484b7 req-b7d18a9f-2f56-4ef4-8054-7de757b0fd11 tempest-VolumesSnapshotsTestJSON-315939754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389" returned: 0 in 0.403s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-e2357f65-c504-46af-9763-add4c00484b7 req-b7d18a9f-2f56-4ef4-8054-7de757b0fd11 tempest-VolumesSnapshotsTestJSON-315939754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:53 devstack sudo[101463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389
Sep 16 16:21:53 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:53 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-e2357f65-c504-46af-9763-add4c00484b7 req-b7d18a9f-2f56-4ef4-8054-7de757b0fd11 tempest-VolumesSnapshotsTestJSON-315939754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-33b2c7da-b8fa-4f05-a426-9419ea0ae389" returned: 0 in 0.282s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-e2357f65-c504-46af-9763-add4c00484b7 req-b7d18a9f-2f56-4ef4-8054-7de757b0fd11 tempest-VolumesSnapshotsTestJSON-315939754 None] Lock "cinder-quobyte-33b2c7da-b8fa-4f05-a426-9419ea0ae389" released by "delete_volume" :: held 0.779s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:53 devstack cinder-volume[86165]: DEBUG cinder.quota [req-e2357f65-c504-46af-9763-add4c00484b7 req-b7d18a9f-2f56-4ef4-8054-7de757b0fd11 tempest-VolumesSnapshotsTestJSON-315939754 None] Created reservations ['79e0d97c-53a4-4b95-8d25-60fcc602f8cc', '0cddce22-480b-4c32-9522-19122749e153', 'ffaa7b90-1c31-4354-bc68-2155ba3343a8', '455f1bdb-b0d5-4f19-b3e9-e955c89f62e0'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:21:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-e2357f65-c504-46af-9763-add4c00484b7 req-b7d18a9f-2f56-4ef4-8054-7de757b0fd11 tempest-VolumesSnapshotsTestJSON-315939754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-e2357f65-c504-46af-9763-add4c00484b7 req-b7d18a9f-2f56-4ef4-8054-7de757b0fd11 tempest-VolumesSnapshotsTestJSON-315939754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [req-e2357f65-c504-46af-9763-add4c00484b7 req-b7d18a9f-2f56-4ef4-8054-7de757b0fd11 tempest-VolumesSnapshotsTestJSON-315939754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [req-e2357f65-c504-46af-9763-add4c00484b7 req-b7d18a9f-2f56-4ef4-8054-7de757b0fd11 tempest-VolumesSnapshotsTestJSON-315939754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-e2357f65-c504-46af-9763-add4c00484b7 req-b7d18a9f-2f56-4ef4-8054-7de757b0fd11 tempest-VolumesSnapshotsTestJSON-315939754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-e2357f65-c504-46af-9763-add4c00484b7 req-b7d18a9f-2f56-4ef4-8054-7de757b0fd11 tempest-VolumesSnapshotsTestJSON-315939754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:54 devstack sudo[101466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:21:54 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:54 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-e2357f65-c504-46af-9763-add4c00484b7 req-b7d18a9f-2f56-4ef4-8054-7de757b0fd11 tempest-VolumesSnapshotsTestJSON-315939754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.268s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:54 devstack cinder-volume[86165]: DEBUG cinder.manager [req-e2357f65-c504-46af-9763-add4c00484b7 req-b7d18a9f-2f56-4ef4-8054-7de757b0fd11 tempest-VolumesSnapshotsTestJSON-315939754 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:21:54 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-e2357f65-c504-46af-9763-add4c00484b7 req-b7d18a9f-2f56-4ef4-8054-7de757b0fd11 tempest-VolumesSnapshotsTestJSON-315939754 None] Deleted volume successfully.
Sep 16 16:21:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-e2357f65-c504-46af-9763-add4c00484b7 req-b7d18a9f-2f56-4ef4-8054-7de757b0fd11 tempest-VolumesSnapshotsTestJSON-315939754 None] Lock "cinder-33b2c7da-b8fa-4f05-a426-9419ea0ae389-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Flow 'volume_create_manager' (78b50e21-64f2-4e26-9214-7e8713840655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81113cac-1c6e-44c4-9fe1-1725d2c8ac15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81113cac-1c6e-44c4-9fe1-1725d2c8ac15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1903857785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4f020686fd6044f9a5e165caa538add5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:59Z,use_quota=True,user_id='e9695241584641f0b387366706f0ffee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d994c0f-9970-4d0b-a65d-c4bd9f51781c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d994c0f-9970-4d0b-a65d-c4bd9f51781c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e62632a-0f29-43c3-b443-24e582c220fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e62632a-0f29-43c3-b443-24e582c220fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed', 'volume_name': 'volume-d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b7a5682-cf16-4a6d-90cd-2535b59c78f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b7a5682-cf16-4a6d-90cd-2535b59c78f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01aa117-65dd-4f1d-879b-ea3748a230a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:58 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Volume d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed', 'volume_size': 1}
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1903857785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4f020686fd6044f9a5e165caa538add5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:59Z,use_quota=True,user_id='e9695241584641f0b387366706f0ffee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Creating volume d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:21:58 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:58 devstack sudo[101469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed 1073741824
Sep 16 16:21:58 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:21:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Flow 'volume_create_manager' (af629d01-c80b-4f7a-a392-06a472784a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185248c4-6a4e-44fc-b5ef-34a324286115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185248c4-6a4e-44fc-b5ef-34a324286115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-149472773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f03d1a4-7502-4cc0-a8f2-d5ee8df49009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8962a208c79847d09f65ee12a725ac87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:59Z,use_quota=True,user_id='2a19ca0929c645bcb166e0b0357b63fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07735de-c5b2-4b1b-866c-6ce88a9d8611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07735de-c5b2-4b1b-866c-6ce88a9d8611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61ce201-fd28-48a6-b7b8-861dba336049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61ce201-fd28-48a6-b7b8-861dba336049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f03d1a4-7502-4cc0-a8f2-d5ee8df49009', 'volume_name': 'volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2136614-6e87-4d85-8170-03f9e24b1b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2136614-6e87-4d85-8170-03f9e24b1b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd352a9-0ddc-44ac-8e84-e390d463f2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:59 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Volume 3f03d1a4-7502-4cc0-a8f2-d5ee8df49009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009', 'volume_size': 1}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:59 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed 1073741824" returned: 0 in 0.433s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:59 devstack sudo[101475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed
Sep 16 16:21:59 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:59 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed" returned: 0 in 0.259s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.440s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-149472773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f03d1a4-7502-4cc0-a8f2-d5ee8df49009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8962a208c79847d09f65ee12a725ac87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:59Z,use_quota=True,user_id='2a19ca0929c645bcb166e0b0357b63fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Creating volume 3f03d1a4-7502-4cc0-a8f2-d5ee8df49009 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:21:59 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:21:59 devstack sudo[101478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009 1073741824
Sep 16 16:21:59 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01aa117-65dd-4f1d-879b-ea3748a230a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f645e1c6-56ae-4474-aca7-a015e362d42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:21:59 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Volume volume-d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed (d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed): created successfully
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f645e1c6-56ae-4474-aca7-a015e362d42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Flow 'volume_create_manager' (78b50e21-64f2-4e26-9214-7e8713840655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:21:59 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-a1f412f3-d5a1-4acb-8edd-44349f6ff482 req-596a0418-94c5-4ad1-a31a-5da6d03501d2 tempest-VolumesGetTestJSON-1049491870 None] Created volume successfully.
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-1df84fce-71b2-4017-b920-431d82b0eae0 req-1a3c83c8-da6d-4c55-8ec2-176bfa2e8a08 tempest-VolumesGetTestJSON-1049491870 None] Acquiring lock "cinder-d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-1df84fce-71b2-4017-b920-431d82b0eae0 req-1a3c83c8-da6d-4c55-8ec2-176bfa2e8a08 tempest-VolumesGetTestJSON-1049491870 None] Lock "cinder-d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-1df84fce-71b2-4017-b920-431d82b0eae0 req-1a3c83c8-da6d-4c55-8ec2-176bfa2e8a08 tempest-VolumesGetTestJSON-1049491870 None] Acquiring lock "cinder-quobyte-d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:21:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-1df84fce-71b2-4017-b920-431d82b0eae0 req-1a3c83c8-da6d-4c55-8ec2-176bfa2e8a08 tempest-VolumesGetTestJSON-1049491870 None] Lock "cinder-quobyte-d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed" acquired by "delete_volume" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[635e6cb4-f107-476a-83ba-e8db62fbcb7a]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-1df84fce-71b2-4017-b920-431d82b0eae0 req-1a3c83c8-da6d-4c55-8ec2-176bfa2e8a08 tempest-VolumesGetTestJSON-1049491870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:00 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009 1073741824" returned: 0 in 0.521s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:00 devstack sudo[101485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009
Sep 16 16:22:00 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:00 devstack sudo[101484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed
Sep 16 16:22:00 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:00 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009" returned: 0 in 0.254s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd352a9-0ddc-44ac-8e84-e390d463f2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73144daa-8843-42f9-af7a-48bb24da574d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:00 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Volume volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009 (3f03d1a4-7502-4cc0-a8f2-d5ee8df49009): created successfully
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73144daa-8843-42f9-af7a-48bb24da574d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Flow 'volume_create_manager' (af629d01-c80b-4f7a-a392-06a472784a48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:22:00 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-0e570e56-ce80-4234-a9f6-18adc37f5b04 tempest-SnapshotDependencyTests-1058888932 None] Created volume successfully.
Sep 16 16:22:00 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-1df84fce-71b2-4017-b920-431d82b0eae0 req-1a3c83c8-da6d-4c55-8ec2-176bfa2e8a08 tempest-VolumesGetTestJSON-1049491870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed" returned: 0 in 0.367s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-1df84fce-71b2-4017-b920-431d82b0eae0 req-1a3c83c8-da6d-4c55-8ec2-176bfa2e8a08 tempest-VolumesGetTestJSON-1049491870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:00 devstack sudo[101492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed
Sep 16 16:22:00 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:00 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-1df84fce-71b2-4017-b920-431d82b0eae0 req-1a3c83c8-da6d-4c55-8ec2-176bfa2e8a08 tempest-VolumesGetTestJSON-1049491870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed" returned: 0 in 0.244s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-1df84fce-71b2-4017-b920-431d82b0eae0 req-1a3c83c8-da6d-4c55-8ec2-176bfa2e8a08 tempest-VolumesGetTestJSON-1049491870 None] Lock "cinder-quobyte-d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed" released by "delete_volume" :: held 0.655s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG cinder.quota [req-1df84fce-71b2-4017-b920-431d82b0eae0 req-1a3c83c8-da6d-4c55-8ec2-176bfa2e8a08 tempest-VolumesGetTestJSON-1049491870 None] Created reservations ['bfd812db-f53a-4c1b-a1c6-ca9bf47f460f', '86714721-29a0-4970-8c97-2a961541d577', '7b57cb52-9dd9-4c5f-9133-9c2fbe480982', '30aed43e-096c-41cb-bc18-0b97f1e728c4'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-1df84fce-71b2-4017-b920-431d82b0eae0 req-1a3c83c8-da6d-4c55-8ec2-176bfa2e8a08 tempest-VolumesGetTestJSON-1049491870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-1df84fce-71b2-4017-b920-431d82b0eae0 req-1a3c83c8-da6d-4c55-8ec2-176bfa2e8a08 tempest-VolumesGetTestJSON-1049491870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [req-1df84fce-71b2-4017-b920-431d82b0eae0 req-1a3c83c8-da6d-4c55-8ec2-176bfa2e8a08 tempest-VolumesGetTestJSON-1049491870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [req-1df84fce-71b2-4017-b920-431d82b0eae0 req-1a3c83c8-da6d-4c55-8ec2-176bfa2e8a08 tempest-VolumesGetTestJSON-1049491870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-1df84fce-71b2-4017-b920-431d82b0eae0 req-1a3c83c8-da6d-4c55-8ec2-176bfa2e8a08 tempest-VolumesGetTestJSON-1049491870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-1df84fce-71b2-4017-b920-431d82b0eae0 req-1a3c83c8-da6d-4c55-8ec2-176bfa2e8a08 tempest-VolumesGetTestJSON-1049491870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:00 devstack sudo[101496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:22:00 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:00 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [req-1df84fce-71b2-4017-b920-431d82b0eae0 req-1a3c83c8-da6d-4c55-8ec2-176bfa2e8a08 tempest-VolumesGetTestJSON-1049491870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.238s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:00 devstack cinder-volume[86165]: DEBUG cinder.manager [req-1df84fce-71b2-4017-b920-431d82b0eae0 req-1a3c83c8-da6d-4c55-8ec2-176bfa2e8a08 tempest-VolumesGetTestJSON-1049491870 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:22:01 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-1df84fce-71b2-4017-b920-431d82b0eae0 req-1a3c83c8-da6d-4c55-8ec2-176bfa2e8a08 tempest-VolumesGetTestJSON-1049491870 None] Deleted volume successfully.
Sep 16 16:22:01 devstack cinder-volume[86165]: DEBUG cinder.coordination [req-1df84fce-71b2-4017-b920-431d82b0eae0 req-1a3c83c8-da6d-4c55-8ec2-176bfa2e8a08 tempest-VolumesGetTestJSON-1049491870 None] Lock "cinder-d27c0cf4-71b2-4fbe-a7a3-c96ffb5ed3ed-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ddfa1785-dc94-4808-9046-4ee8b22d3962 tempest-SnapshotDependencyTests-1058888932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ddfa1785-dc94-4808-9046-4ee8b22d3962 tempest-SnapshotDependencyTests-1058888932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:01 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-ddfa1785-dc94-4808-9046-4ee8b22d3962 tempest-SnapshotDependencyTests-1058888932 None] Creating offline snapshot 9bda6b93-646a-4f4d-80cf-fe1d9d06cefc of volume 3f03d1a4-7502-4cc0-a8f2-d5ee8df49009 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:22:01 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[015ec407-93f6-4873-9957-0d7cadf515f8]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ddfa1785-dc94-4808-9046-4ee8b22d3962 tempest-SnapshotDependencyTests-1058888932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:01 devstack sudo[101499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009
Sep 16 16:22:01 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:01 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ddfa1785-dc94-4808-9046-4ee8b22d3962 tempest-SnapshotDependencyTests-1058888932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009" returned: 0 in 0.392s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ddfa1785-dc94-4808-9046-4ee8b22d3962 tempest-SnapshotDependencyTests-1058888932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:01 devstack sudo[101504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc 1G
Sep 16 16:22:01 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:02 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ddfa1785-dc94-4808-9046-4ee8b22d3962 tempest-SnapshotDependencyTests-1058888932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc 1G" returned: 0 in 0.464s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ddfa1785-dc94-4808-9046-4ee8b22d3962 tempest-SnapshotDependencyTests-1058888932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:02 devstack sudo[101545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc
Sep 16 16:22:02 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:02 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ddfa1785-dc94-4808-9046-4ee8b22d3962 tempest-SnapshotDependencyTests-1058888932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc" returned: 0 in 0.322s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:02 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-ddfa1785-dc94-4808-9046-4ee8b22d3962 tempest-SnapshotDependencyTests-1058888932 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc is being set with open permissions: ugo+rw
Sep 16 16:22:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ddfa1785-dc94-4808-9046-4ee8b22d3962 tempest-SnapshotDependencyTests-1058888932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:02 devstack sudo[101551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc
Sep 16 16:22:02 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:02 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ddfa1785-dc94-4808-9046-4ee8b22d3962 tempest-SnapshotDependencyTests-1058888932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc" returned: 0 in 0.261s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ddfa1785-dc94-4808-9046-4ee8b22d3962 tempest-SnapshotDependencyTests-1058888932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:02 devstack sudo[101555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.info
Sep 16 16:22:02 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:03 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ddfa1785-dc94-4808-9046-4ee8b22d3962 tempest-SnapshotDependencyTests-1058888932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.info" returned: 0 in 0.262s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:03 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-ddfa1785-dc94-4808-9046-4ee8b22d3962 tempest-SnapshotDependencyTests-1058888932 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.info is being set with open permissions: ugo+rw
Sep 16 16:22:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ddfa1785-dc94-4808-9046-4ee8b22d3962 tempest-SnapshotDependencyTests-1058888932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:03 devstack sudo[101558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.info
Sep 16 16:22:03 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:03 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ddfa1785-dc94-4808-9046-4ee8b22d3962 tempest-SnapshotDependencyTests-1058888932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.info" returned: 0 in 0.270s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ddfa1785-dc94-4808-9046-4ee8b22d3962 tempest-SnapshotDependencyTests-1058888932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.073s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:03 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-ddfa1785-dc94-4808-9046-4ee8b22d3962 tempest-SnapshotDependencyTests-1058888932 None] Create snapshot completed successfully
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Flow 'volume_create_manager' (7b7b6b6d-fe34-4344-b707-23d15b97e0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716832de-6c3f-4dc7-98c5-b7a07de93e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716832de-6c3f-4dc7-98c5-b7a07de93e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d172f48-ead1-43e8-95cd-88ad19913d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8962a208c79847d09f65ee12a725ac87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9bda6b93-646a-4f4d-80cf-fe1d9d06cefc,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:05Z,use_quota=True,user_id='2a19ca0929c645bcb166e0b0357b63fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c60495f-2bf9-4dbc-a833-465f443be72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c60495f-2bf9-4dbc-a833-465f443be72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ead0a8f-6a6a-47bf-9a55-93d630589b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ead0a8f-6a6a-47bf-9a55-93d630589b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8d172f48-ead1-43e8-95cd-88ad19913d47', 'volume_name': 'volume-8d172f48-ead1-43e8-95cd-88ad19913d47', 'volume_size': 1, 'snapshot_id': '9bda6b93-646a-4f4d-80cf-fe1d9d06cefc'}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b02a98-3af6-4a11-ba92-586c36fbe83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b02a98-3af6-4a11-ba92-586c36fbe83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876bcd36-2f01-49d6-8e0b-d89c5e53baf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:05 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Volume 8d172f48-ead1-43e8-95cd-88ad19913d47: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8d172f48-ead1-43e8-95cd-88ad19913d47', 'volume_size': 1, 'snapshot_id': '9bda6b93-646a-4f4d-80cf-fe1d9d06cefc'}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Acquiring lock "cinder-quobyte-9bda6b93-646a-4f4d-80cf-fe1d9d06cefc-8d172f48-ead1-43e8-95cd-88ad19913d47" by "_create_volume_from_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Lock "cinder-quobyte-9bda6b93-646a-4f4d-80cf-fe1d9d06cefc-8d172f48-ead1-43e8-95cd-88ad19913d47" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Creating volume 8d172f48-ead1-43e8-95cd-88ad19913d47 from snapshot 9bda6b93-646a-4f4d-80cf-fe1d9d06cefc {{(pid=86165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Acquiring lock "cinder-quobyte-8d172f48-ead1-43e8-95cd-88ad19913d47" by "_copy_volume_from_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Lock "cinder-quobyte-8d172f48-ead1-43e8-95cd-88ad19913d47" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] snapshot: 9bda6b93-646a-4f4d-80cf-fe1d9d06cefc, volume: 8d172f48-ead1-43e8-95cd-88ad19913d47,  {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ae1d6b-42a6-4bd7-add9-2c0625a080dd]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:05 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b7c73a4d-76eb-4e85-8f5b-049e5a14639a tempest-GroupSnapshotsTest-478537237 None] Group tempest-GroupSnapshotsTest-Group-2044135865: creating
Sep 16 16:22:05 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b7c73a4d-76eb-4e85-8f5b-049e5a14639a tempest-GroupSnapshotsTest-478537237 None] Group tempest-GroupSnapshotsTest-Group-2044135865: created successfully
Sep 16 16:22:05 devstack sudo[101561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc
Sep 16 16:22:05 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:05 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b7c73a4d-76eb-4e85-8f5b-049e5a14639a tempest-GroupSnapshotsTest-478537237 None] Create group completed successfully.
Sep 16 16:22:05 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc" returned: 0 in 0.370s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28ad238-8bac-4500-90e9-360cf4864c28]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:05 devstack sudo[101566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009
Sep 16 16:22:05 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:06 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009" returned: 0 in 0.358s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:06 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] will copy from snapshot at /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009 {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 16:22:06 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Creating direct copy from snapshot {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 16:22:06 devstack cinder-volume[86165]: DEBUG cinder.utils [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Path /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8d172f48-ead1-43e8-95cd-88ad19913d47 not found in is_blk_device check {{(pid=86165) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 16:22:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8d172f48-ead1-43e8-95cd-88ad19913d47 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:06 devstack sudo[101571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8d172f48-ead1-43e8-95cd-88ad19913d47
Sep 16 16:22:06 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:07 devstack sudo[101583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:22:07 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Flow 'volume_create_manager' (c3ccc763-1b5f-4550-ba95-e603a772fb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f305675-1f60-4c36-8fec-bf7a0c8a502d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f305675-1f60-4c36-8fec-bf7a0c8a502d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-664463621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2418d057-0f84-4117-89d6-9ef7deea0e21,host='devstack@QuobyteHD#QuobyteHD',id=02166d61-25e6-485e-9f5e-7f27a0e950d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc28de8620f34ba1a5b997e9a6b24dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:07Z,use_quota=True,user_id='00262b1fca0e4c56a69ab1a9a672964f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c09677b7-b4a7-4e8e-8cb8-d6f4269cfa8d),volume_type_id=c09677b7-b4a7-4e8e-8cb8-d6f4269cfa8d)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd08c81-5e92-4b1e-8100-59859a739f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd08c81-5e92-4b1e-8100-59859a739f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b838c08-d89a-4069-b64a-42ab07332d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b838c08-d89a-4069-b64a-42ab07332d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02166d61-25e6-485e-9f5e-7f27a0e950d4', 'volume_name': 'volume-02166d61-25e6-485e-9f5e-7f27a0e950d4', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9076c03d-8bd9-455b-8fe5-7d0acdafb72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:07 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9076c03d-8bd9-455b-8fe5-7d0acdafb72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d633b1d0-02b6-48b0-ab19-d640ce98d7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:07 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Volume 02166d61-25e6-485e-9f5e-7f27a0e950d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02166d61-25e6-485e-9f5e-7f27a0e950d4', 'volume_size': 1}
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.629s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 29 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:22:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>, <Thread(tpool_thread_0, started daemon 135438770624192)>, <Thread(tpool_thread_1, started daemon 135438762231488)>, <Thread(tpool_thread_2, started daemon 135438753838784)>, <Thread(tpool_thread_3, started daemon 135438745446080)>, <Thread(tpool_thread_4, started daemon 135438737053376)>, <Thread(tpool_thread_5, started daemon 135438728660672)>, <Thread(tpool_thread_6, started daemon 135438720267968)>, <Thread(tpool_thread_7, started daemon 135438711875264)>, <Thread(tpool_thread_8, started daemon 135438703466176)>, <Thread(tpool_thread_9, started daemon 135438695057088)>, <Thread(tpool_thread_10, started daemon 135438686648000)>, <Thread(tpool_thread_11, started daemon 135438678238912)>, <Thread(tpool_thread_12, started daemon 135438669829824)>, <Thread(tpool_thread_13, started daemon 135438661420736)>, <Thread(tpool_thread_14, started daemon 135438653011648)>, <Thread(tpool_thread_15, started daemon 135438644602560)>, <Thread(tpool_thread_16, started daemon 135438636193472)>, <Thread(tpool_thread_17, started daemon 135438627784384)>, <Thread(tpool_thread_18, started daemon 135438619375296)>, <Thread(tpool_thread_19, started daemon 135438610966208)>, <Thread(Rabbit-heartbeat, started daemon 135438772197760)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:22:12 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8d172f48-ead1-43e8-95cd-88ad19913d47" returned: 0 in 6.071s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Image conversion details: src /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8d172f48-ead1-43e8-95cd-88ad19913d47 {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:22:12 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Converted 1024.00 MB image at 168.63 MB/s
Sep 16 16:22:12 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8d172f48-ead1-43e8-95cd-88ad19913d47 is being set with open permissions: ugo+rw
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8d172f48-ead1-43e8-95cd-88ad19913d47 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:12 devstack sudo[101588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8d172f48-ead1-43e8-95cd-88ad19913d47
Sep 16 16:22:12 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:12 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8d172f48-ead1-43e8-95cd-88ad19913d47" returned: 0 in 0.239s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Lock "cinder-quobyte-8d172f48-ead1-43e8-95cd-88ad19913d47" released by "_copy_volume_from_snapshot" :: held 7.132s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Lock "cinder-quobyte-9bda6b93-646a-4f4d-80cf-fe1d9d06cefc-8d172f48-ead1-43e8-95cd-88ad19913d47" released by "_create_volume_from_snapshot" :: held 7.196s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.215s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.637s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2418d057-0f84-4117-89d6-9ef7deea0e21,created_at=2026-09-16T14:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-664463621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2418d057-0f84-4117-89d6-9ef7deea0e21,host='devstack@QuobyteHD#QuobyteHD',id=02166d61-25e6-485e-9f5e-7f27a0e950d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc28de8620f34ba1a5b997e9a6b24dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:07Z,use_quota=True,user_id='00262b1fca0e4c56a69ab1a9a672964f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c09677b7-b4a7-4e8e-8cb8-d6f4269cfa8d),volume_type_id=c09677b7-b4a7-4e8e-8cb8-d6f4269cfa8d)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Creating volume 02166d61-25e6-485e-9f5e-7f27a0e950d4 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:22:12 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:12 devstack sudo[101591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4 1073741824
Sep 16 16:22:12 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876bcd36-2f01-49d6-8e0b-d89c5e53baf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d172f48-ead1-43e8-95cd-88ad19913d47', 'volume_size': 1, 'snapshot_id': '9bda6b93-646a-4f4d-80cf-fe1d9d06cefc'}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1edd2763-8bb8-40c6-9c02-d6a41a89d15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:12 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Volume volume-8d172f48-ead1-43e8-95cd-88ad19913d47 (8d172f48-ead1-43e8-95cd-88ad19913d47): created successfully
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1edd2763-8bb8-40c6-9c02-d6a41a89d15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Flow 'volume_create_manager' (7b7b6b6d-fe34-4344-b707-23d15b97e0d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:22:12 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-db8321cf-cec8-47ee-9892-457bdd7f2717 tempest-SnapshotDependencyTests-1058888932 None] Created volume successfully.
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a16c9bcc-7b20-4ec8-a231-d851db903f93 tempest-SnapshotDependencyTests-1058888932 None] Acquiring lock "cinder-9bda6b93-646a-4f4d-80cf-fe1d9d06cefc-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a16c9bcc-7b20-4ec8-a231-d851db903f93 tempest-SnapshotDependencyTests-1058888932 None] Lock "cinder-9bda6b93-646a-4f4d-80cf-fe1d9d06cefc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a16c9bcc-7b20-4ec8-a231-d851db903f93 tempest-SnapshotDependencyTests-1058888932 None] Acquiring lock "cinder-quobyte-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a16c9bcc-7b20-4ec8-a231-d851db903f93 tempest-SnapshotDependencyTests-1058888932 None] Lock "cinder-quobyte-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a16c9bcc-7b20-4ec8-a231-d851db903f93 tempest-SnapshotDependencyTests-1058888932 None] Acquiring lock "cinder-quobyte-9bda6b93-646a-4f4d-80cf-fe1d9d06cefc" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a16c9bcc-7b20-4ec8-a231-d851db903f93 tempest-SnapshotDependencyTests-1058888932 None] Lock "cinder-quobyte-9bda6b93-646a-4f4d-80cf-fe1d9d06cefc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-a16c9bcc-7b20-4ec8-a231-d851db903f93 tempest-SnapshotDependencyTests-1058888932 None] Deleting offline snapshot 9bda6b93-646a-4f4d-80cf-fe1d9d06cefc of volume 3f03d1a4-7502-4cc0-a8f2-d5ee8df49009 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-a16c9bcc-7b20-4ec8-a231-d851db903f93 tempest-SnapshotDependencyTests-1058888932 None] snapshot_file for this snap is: volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:22:12 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbb7347-cd48-4099-b43d-532c5b66b07d]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a16c9bcc-7b20-4ec8-a231-d851db903f93 tempest-SnapshotDependencyTests-1058888932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4 1073741824" returned: 0 in 0.501s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:12 devstack sudo[101604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4
Sep 16 16:22:12 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:13 devstack sudo[101603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc
Sep 16 16:22:13 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:13 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4" returned: 0 in 0.255s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:22:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d633b1d0-02b6-48b0-ab19-d640ce98d7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02166d61-25e6-485e-9f5e-7f27a0e950d4', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014e700f-8618-4aad-be39-1bdaa9d96942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:13 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Volume volume-02166d61-25e6-485e-9f5e-7f27a0e950d4 (02166d61-25e6-485e-9f5e-7f27a0e950d4): created successfully
Sep 16 16:22:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014e700f-8618-4aad-be39-1bdaa9d96942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Flow 'volume_create_manager' (c3ccc763-1b5f-4550-ba95-e603a772fb2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:22:13 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-6c624c2c-f211-4d2b-875f-c3c8339be85d tempest-GroupSnapshotsTest-478537237 None] Created volume successfully.
Sep 16 16:22:13 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a16c9bcc-7b20-4ec8-a231-d851db903f93 tempest-SnapshotDependencyTests-1058888932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc" returned: 0 in 0.380s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-a16c9bcc-7b20-4ec8-a231-d851db903f93 tempest-SnapshotDependencyTests-1058888932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:22:13 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafed2c0-7bab-4625-b782-f65ff06f4a2d]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a16c9bcc-7b20-4ec8-a231-d851db903f93 tempest-SnapshotDependencyTests-1058888932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:13 devstack sudo[101612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009
Sep 16 16:22:13 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:13 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a16c9bcc-7b20-4ec8-a231-d851db903f93 tempest-SnapshotDependencyTests-1058888932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009" returned: 0 in 0.549s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a16c9bcc-7b20-4ec8-a231-d851db903f93 tempest-SnapshotDependencyTests-1058888932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:13 devstack sudo[101617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc
Sep 16 16:22:13 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:14 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-3cd0a23c-7572-416e-bfe8-f9e92d795b0a tempest-GroupSnapshotsTest-478537237 None] GroupSnapshot d33b62b0-f35f-4b4e-b4a2-c955699d69f9: creating.
Sep 16 16:22:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3cd0a23c-7572-416e-bfe8-f9e92d795b0a tempest-GroupSnapshotsTest-478537237 None] Group snapshot d33b62b0-f35f-4b4e-b4a2-c955699d69f9: creating. {{(pid=86165) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 16 16:22:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3cd0a23c-7572-416e-bfe8-f9e92d795b0a tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3cd0a23c-7572-416e-bfe8-f9e92d795b0a tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-3cd0a23c-7572-416e-bfe8-f9e92d795b0a tempest-GroupSnapshotsTest-478537237 None] Creating offline snapshot 682044b2-e3ef-434e-b880-288c10bc3f27 of volume 02166d61-25e6-485e-9f5e-7f27a0e950d4 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:22:14 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fc40be-a037-406e-b548-eda38ccd9edd]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3cd0a23c-7572-416e-bfe8-f9e92d795b0a tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:14 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a16c9bcc-7b20-4ec8-a231-d851db903f93 tempest-SnapshotDependencyTests-1058888932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc" returned: 0 in 0.357s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a16c9bcc-7b20-4ec8-a231-d851db903f93 tempest-SnapshotDependencyTests-1058888932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:14 devstack sudo[101623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc
Sep 16 16:22:14 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:14 devstack sudo[101622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4
Sep 16 16:22:14 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:14 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a16c9bcc-7b20-4ec8-a231-d851db903f93 tempest-SnapshotDependencyTests-1058888932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009.9bda6b93-646a-4f4d-80cf-fe1d9d06cefc" returned: 0 in 0.256s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a16c9bcc-7b20-4ec8-a231-d851db903f93 tempest-SnapshotDependencyTests-1058888932 None] Lock "cinder-quobyte-9bda6b93-646a-4f4d-80cf-fe1d9d06cefc" released by "_delete_snapshot" :: held 1.670s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a16c9bcc-7b20-4ec8-a231-d851db903f93 tempest-SnapshotDependencyTests-1058888932 None] Lock "cinder-quobyte-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009" released by "delete_snapshot" :: held 1.702s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:14 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-a16c9bcc-7b20-4ec8-a231-d851db903f93 tempest-SnapshotDependencyTests-1058888932 None] Created reservations ['e1fb8b83-d81d-4361-9b21-9b16fce4c9a2', '63b1eefd-c6a2-4b25-a4ed-8516efca0666', '672a0577-3b1a-4098-9f0c-4c44dae30e5e', 'e72a66ec-e022-4e10-9bb4-8bcb894b2d3a'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:22:14 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3cd0a23c-7572-416e-bfe8-f9e92d795b0a tempest-GroupSnapshotsTest-478537237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4" returned: 0 in 0.422s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3cd0a23c-7572-416e-bfe8-f9e92d795b0a tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:14 devstack sudo[101630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27 1G
Sep 16 16:22:14 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:14 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-a16c9bcc-7b20-4ec8-a231-d851db903f93 tempest-SnapshotDependencyTests-1058888932 None] Delete snapshot completed successfully.
Sep 16 16:22:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a16c9bcc-7b20-4ec8-a231-d851db903f93 tempest-SnapshotDependencyTests-1058888932 None] Lock "cinder-9bda6b93-646a-4f4d-80cf-fe1d9d06cefc-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-804498dc-5884-4b13-9662-546a2c05af78 tempest-SnapshotDependencyTests-1058888932 None] Acquiring lock "cinder-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:22:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-804498dc-5884-4b13-9662-546a2c05af78 tempest-SnapshotDependencyTests-1058888932 None] Lock "cinder-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:22:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-804498dc-5884-4b13-9662-546a2c05af78 tempest-SnapshotDependencyTests-1058888932 None] Acquiring lock "cinder-quobyte-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:22:15 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3cd0a23c-7572-416e-bfe8-f9e92d795b0a tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27 1G" returned: 0 in 0.430s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3cd0a23c-7572-416e-bfe8-f9e92d795b0a tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02166d61-25e6-485e-9f5e-7f27a0e950d4 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-804498dc-5884-4b13-9662-546a2c05af78 tempest-SnapshotDependencyTests-1058888932 None] Lock "cinder-quobyte-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009" acquired by "delete_volume" :: waited 0.036s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:22:15 devstack sudo[101636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02166d61-25e6-485e-9f5e-7f27a0e950d4 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27
Sep 16 16:22:15 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:15 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a244e7-115f-4a1b-8956-25bd00085b4f]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-804498dc-5884-4b13-9662-546a2c05af78 tempest-SnapshotDependencyTests-1058888932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:15 devstack sudo[101638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009
Sep 16 16:22:15 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:15 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:15 devstack sudo[101645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27
Sep 16 16:22:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3cd0a23c-7572-416e-bfe8-f9e92d795b0a tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02166d61-25e6-485e-9f5e-7f27a0e950d4 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27" returned: 0 in 0.363s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:15 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-3cd0a23c-7572-416e-bfe8-f9e92d795b0a tempest-GroupSnapshotsTest-478537237 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27 is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 16:22:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3cd0a23c-7572-416e-bfe8-f9e92d795b0a tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:15 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:15 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-804498dc-5884-4b13-9662-546a2c05af78 tempest-SnapshotDependencyTests-1058888932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009" returned: 0 in 0.431s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-804498dc-5884-4b13-9662-546a2c05af78 tempest-SnapshotDependencyTests-1058888932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:15 devstack sudo[101650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009
Sep 16 16:22:15 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:15 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3cd0a23c-7572-416e-bfe8-f9e92d795b0a tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27" returned: 0 in 0.263s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3cd0a23c-7572-416e-bfe8-f9e92d795b0a tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:15 devstack sudo[101653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.info
Sep 16 16:22:15 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:15 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-804498dc-5884-4b13-9662-546a2c05af78 tempest-SnapshotDependencyTests-1058888932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009" returned: 0 in 0.280s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-804498dc-5884-4b13-9662-546a2c05af78 tempest-SnapshotDependencyTests-1058888932 None] Lock "cinder-quobyte-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009" released by "delete_volume" :: held 0.799s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:15 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-804498dc-5884-4b13-9662-546a2c05af78 tempest-SnapshotDependencyTests-1058888932 None] Created reservations ['0efdcb20-d09e-4545-b0cc-de096f17ea42', '76709171-1540-40b9-b9b4-c7b9268f293a', 'aff2cb3a-6fe2-41cd-9df2-426a713907d3', '15b60c00-c1ea-4a00-92af-fb306662c135'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-804498dc-5884-4b13-9662-546a2c05af78 tempest-SnapshotDependencyTests-1058888932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-804498dc-5884-4b13-9662-546a2c05af78 tempest-SnapshotDependencyTests-1058888932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-804498dc-5884-4b13-9662-546a2c05af78 tempest-SnapshotDependencyTests-1058888932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-804498dc-5884-4b13-9662-546a2c05af78 tempest-SnapshotDependencyTests-1058888932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-804498dc-5884-4b13-9662-546a2c05af78 tempest-SnapshotDependencyTests-1058888932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-804498dc-5884-4b13-9662-546a2c05af78 tempest-SnapshotDependencyTests-1058888932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:16 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3cd0a23c-7572-416e-bfe8-f9e92d795b0a tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.info" returned: 0 in 0.299s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:16 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-3cd0a23c-7572-416e-bfe8-f9e92d795b0a tempest-GroupSnapshotsTest-478537237 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3cd0a23c-7572-416e-bfe8-f9e92d795b0a tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:16 devstack sudo[101657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:22:16 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:16 devstack sudo[101658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.info
Sep 16 16:22:16 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-417e580a-0a7b-4741-ad61-f34e0cdc7849 tempest-SnapshotDependencyTests-1058888932 None] Acquiring lock "cinder-8d172f48-ead1-43e8-95cd-88ad19913d47-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-417e580a-0a7b-4741-ad61-f34e0cdc7849 tempest-SnapshotDependencyTests-1058888932 None] Lock "cinder-8d172f48-ead1-43e8-95cd-88ad19913d47-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-417e580a-0a7b-4741-ad61-f34e0cdc7849 tempest-SnapshotDependencyTests-1058888932 None] Acquiring lock "cinder-quobyte-8d172f48-ead1-43e8-95cd-88ad19913d47" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-417e580a-0a7b-4741-ad61-f34e0cdc7849 tempest-SnapshotDependencyTests-1058888932 None] Lock "cinder-quobyte-8d172f48-ead1-43e8-95cd-88ad19913d47" acquired by "delete_volume" :: waited 0.023s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:22:16 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-804498dc-5884-4b13-9662-546a2c05af78 tempest-SnapshotDependencyTests-1058888932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.296s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-804498dc-5884-4b13-9662-546a2c05af78 tempest-SnapshotDependencyTests-1058888932 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa4193f-3774-4e9e-a952-8e45c73c6a8c]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-417e580a-0a7b-4741-ad61-f34e0cdc7849 tempest-SnapshotDependencyTests-1058888932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8d172f48-ead1-43e8-95cd-88ad19913d47 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:16 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-804498dc-5884-4b13-9662-546a2c05af78 tempest-SnapshotDependencyTests-1058888932 None] Deleted volume successfully.
Sep 16 16:22:16 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3cd0a23c-7572-416e-bfe8-f9e92d795b0a tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.info" returned: 0 in 0.326s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3cd0a23c-7572-416e-bfe8-f9e92d795b0a tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.194s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-804498dc-5884-4b13-9662-546a2c05af78 tempest-SnapshotDependencyTests-1058888932 None] Lock "cinder-3f03d1a4-7502-4cc0-a8f2-d5ee8df49009-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:16 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-3cd0a23c-7572-416e-bfe8-f9e92d795b0a tempest-GroupSnapshotsTest-478537237 None] group_snapshot d33b62b0-f35f-4b4e-b4a2-c955699d69f9: created successfully
Sep 16 16:22:16 devstack sudo[101663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8d172f48-ead1-43e8-95cd-88ad19913d47
Sep 16 16:22:16 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:16 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-417e580a-0a7b-4741-ad61-f34e0cdc7849 tempest-SnapshotDependencyTests-1058888932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8d172f48-ead1-43e8-95cd-88ad19913d47" returned: 0 in 0.399s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-417e580a-0a7b-4741-ad61-f34e0cdc7849 tempest-SnapshotDependencyTests-1058888932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8d172f48-ead1-43e8-95cd-88ad19913d47 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:16 devstack sudo[101668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8d172f48-ead1-43e8-95cd-88ad19913d47
Sep 16 16:22:16 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:16 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-417e580a-0a7b-4741-ad61-f34e0cdc7849 tempest-SnapshotDependencyTests-1058888932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8d172f48-ead1-43e8-95cd-88ad19913d47" returned: 0 in 0.250s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-417e580a-0a7b-4741-ad61-f34e0cdc7849 tempest-SnapshotDependencyTests-1058888932 None] Lock "cinder-quobyte-8d172f48-ead1-43e8-95cd-88ad19913d47" released by "delete_volume" :: held 0.711s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:17 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-417e580a-0a7b-4741-ad61-f34e0cdc7849 tempest-SnapshotDependencyTests-1058888932 None] Created reservations ['c7972c38-186e-483e-a141-be3efe4b6108', '04c1c97e-8219-4122-a798-4a96059316ea', 'e1c5c7ce-368c-4c3f-be5f-d7803d7c98cb', 'aeb08736-0528-44be-9687-aac387ef58e1'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:22:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-417e580a-0a7b-4741-ad61-f34e0cdc7849 tempest-SnapshotDependencyTests-1058888932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-417e580a-0a7b-4741-ad61-f34e0cdc7849 tempest-SnapshotDependencyTests-1058888932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-417e580a-0a7b-4741-ad61-f34e0cdc7849 tempest-SnapshotDependencyTests-1058888932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:22:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-417e580a-0a7b-4741-ad61-f34e0cdc7849 tempest-SnapshotDependencyTests-1058888932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:22:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-417e580a-0a7b-4741-ad61-f34e0cdc7849 tempest-SnapshotDependencyTests-1058888932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-417e580a-0a7b-4741-ad61-f34e0cdc7849 tempest-SnapshotDependencyTests-1058888932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:17 devstack sudo[101671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:22:17 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:17 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-417e580a-0a7b-4741-ad61-f34e0cdc7849 tempest-SnapshotDependencyTests-1058888932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.268s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:17 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-417e580a-0a7b-4741-ad61-f34e0cdc7849 tempest-SnapshotDependencyTests-1058888932 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:22:17 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-417e580a-0a7b-4741-ad61-f34e0cdc7849 tempest-SnapshotDependencyTests-1058888932 None] Deleted volume successfully.
Sep 16 16:22:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-417e580a-0a7b-4741-ad61-f34e0cdc7849 tempest-SnapshotDependencyTests-1058888932 None] Lock "cinder-8d172f48-ead1-43e8-95cd-88ad19913d47-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "cinder-quobyte-682044b2-e3ef-434e-b880-288c10bc3f27-4bcab81f-3d13-45f8-aad4-3727684a3c07" by "_create_volume_from_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-682044b2-e3ef-434e-b880-288c10bc3f27-4bcab81f-3d13-45f8-aad4-3727684a3c07" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Creating volume 4bcab81f-3d13-45f8-aad4-3727684a3c07 from snapshot 682044b2-e3ef-434e-b880-288c10bc3f27 {{(pid=86165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "cinder-quobyte-4bcab81f-3d13-45f8-aad4-3727684a3c07" by "_copy_volume_from_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-4bcab81f-3d13-45f8-aad4-3727684a3c07" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] snapshot: 682044b2-e3ef-434e-b880-288c10bc3f27, volume: 4bcab81f-3d13-45f8-aad4-3727684a3c07,  {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d232f1b6-d1e8-447f-8cba-e96a87c414dc]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:18 devstack sudo[101674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27
Sep 16 16:22:18 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:18 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27" returned: 0 in 0.488s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02166d61-25e6-485e-9f5e-7f27a0e950d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c618b4-3790-41b6-9a82-c57dc769a4cc]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:18 devstack sudo[101679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4
Sep 16 16:22:18 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:19 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4" returned: 0 in 0.428s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] will copy from snapshot at /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4 {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 16:22:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Creating direct copy from snapshot {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 16:22:19 devstack cinder-volume[86165]: DEBUG cinder.utils [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Path /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4bcab81f-3d13-45f8-aad4-3727684a3c07 not found in is_blk_device check {{(pid=86165) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 16:22:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4bcab81f-3d13-45f8-aad4-3727684a3c07 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:19 devstack sudo[101685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4bcab81f-3d13-45f8-aad4-3727684a3c07
Sep 16 16:22:19 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:25 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4bcab81f-3d13-45f8-aad4-3727684a3c07" returned: 0 in 6.734s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:25 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Image conversion details: src /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4, size 1024.00 MB, duration 6.73 sec, destination /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4bcab81f-3d13-45f8-aad4-3727684a3c07 {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:22:25 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Converted 1024.00 MB image at 152.05 MB/s
Sep 16 16:22:25 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4bcab81f-3d13-45f8-aad4-3727684a3c07 is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 16:22:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4bcab81f-3d13-45f8-aad4-3727684a3c07 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:25 devstack sudo[101700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4bcab81f-3d13-45f8-aad4-3727684a3c07
Sep 16 16:22:25 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:26 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4bcab81f-3d13-45f8-aad4-3727684a3c07" returned: 0 in 0.285s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-4bcab81f-3d13-45f8-aad4-3727684a3c07" released by "_copy_volume_from_snapshot" :: held 8.052s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-682044b2-e3ef-434e-b880-288c10bc3f27-4bcab81f-3d13-45f8-aad4-3727684a3c07" released by "_create_volume_from_snapshot" :: held 8.125s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.146s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:26 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c7234dc9-7935-4589-b633-1a1adb3a85c9 tempest-GroupSnapshotsTest-478537237 None] Create group from source-snapshot-d33b62b0-f35f-4b4e-b4a2-c955699d69f9 completed successfully.
Sep 16 16:22:27 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-85367ee9-3132-4ab9-93b8-fe66d0fd1973 tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "cinder-quobyte-4bcab81f-3d13-45f8-aad4-3727684a3c07" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:22:27 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-85367ee9-3132-4ab9-93b8-fe66d0fd1973 tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-4bcab81f-3d13-45f8-aad4-3727684a3c07" acquired by "delete_volume" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:22:27 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d9cc53-f73c-4b47-9231-4f0b182fdd84]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-85367ee9-3132-4ab9-93b8-fe66d0fd1973 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4bcab81f-3d13-45f8-aad4-3727684a3c07 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:27 devstack sudo[101705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4bcab81f-3d13-45f8-aad4-3727684a3c07
Sep 16 16:22:27 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:27 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-85367ee9-3132-4ab9-93b8-fe66d0fd1973 tempest-GroupSnapshotsTest-478537237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4bcab81f-3d13-45f8-aad4-3727684a3c07" returned: 0 in 0.399s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-85367ee9-3132-4ab9-93b8-fe66d0fd1973 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4bcab81f-3d13-45f8-aad4-3727684a3c07 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:27 devstack sudo[101710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4bcab81f-3d13-45f8-aad4-3727684a3c07
Sep 16 16:22:27 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:28 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-85367ee9-3132-4ab9-93b8-fe66d0fd1973 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4bcab81f-3d13-45f8-aad4-3727684a3c07" returned: 0 in 0.276s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-85367ee9-3132-4ab9-93b8-fe66d0fd1973 tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-4bcab81f-3d13-45f8-aad4-3727684a3c07" released by "delete_volume" :: held 0.747s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:28 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-85367ee9-3132-4ab9-93b8-fe66d0fd1973 tempest-GroupSnapshotsTest-478537237 None] Created reservations ['1f744fb1-32d6-43eb-b026-4d5287d7a5a1'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:22:28 devstack cinder-volume[86165]: WARNING cinder.quota [None req-85367ee9-3132-4ab9-93b8-fe66d0fd1973 tempest-GroupSnapshotsTest-478537237 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-466002633 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-466002633, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:22:28 devstack cinder-volume[86165]: WARNING cinder.quota [None req-85367ee9-3132-4ab9-93b8-fe66d0fd1973 tempest-GroupSnapshotsTest-478537237 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-466002633 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-466002633, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:22:28 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-85367ee9-3132-4ab9-93b8-fe66d0fd1973 tempest-GroupSnapshotsTest-478537237 None] Created reservations ['7696b012-0f52-43df-83af-ddd110eb909f', '4fb64819-d385-48c9-83e7-87d6f82e5bcc', '542ee94b-1a09-4b57-b521-e631986085b2', '5a21dbf5-fbf6-48c2-b971-366c19389ff7'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:22:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-85367ee9-3132-4ab9-93b8-fe66d0fd1973 tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-85367ee9-3132-4ab9-93b8-fe66d0fd1973 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:28 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-85367ee9-3132-4ab9-93b8-fe66d0fd1973 tempest-GroupSnapshotsTest-478537237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:22:28 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-85367ee9-3132-4ab9-93b8-fe66d0fd1973 tempest-GroupSnapshotsTest-478537237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:22:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-85367ee9-3132-4ab9-93b8-fe66d0fd1973 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-85367ee9-3132-4ab9-93b8-fe66d0fd1973 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:28 devstack sudo[101713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:22:28 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:28 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-85367ee9-3132-4ab9-93b8-fe66d0fd1973 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.278s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:28 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-85367ee9-3132-4ab9-93b8-fe66d0fd1973 tempest-GroupSnapshotsTest-478537237 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:22:28 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-5b44c1e8-3684-4aca-8ce0-acd1ac6b7cca tempest-GroupSnapshotsTest-478537237 None] group_snapshot d33b62b0-f35f-4b4e-b4a2-c955699d69f9: deleting
Sep 16 16:22:28 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-85367ee9-3132-4ab9-93b8-fe66d0fd1973 tempest-GroupSnapshotsTest-478537237 None] Delete group completed successfully.
Sep 16 16:22:28 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5b44c1e8-3684-4aca-8ce0-acd1ac6b7cca tempest-GroupSnapshotsTest-478537237 None] group_snapshot d33b62b0-f35f-4b4e-b4a2-c955699d69f9: deleting {{(pid=86165) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 16 16:22:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5b44c1e8-3684-4aca-8ce0-acd1ac6b7cca tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "cinder-quobyte-02166d61-25e6-485e-9f5e-7f27a0e950d4" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:22:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5b44c1e8-3684-4aca-8ce0-acd1ac6b7cca tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-02166d61-25e6-485e-9f5e-7f27a0e950d4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:22:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5b44c1e8-3684-4aca-8ce0-acd1ac6b7cca tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "cinder-quobyte-682044b2-e3ef-434e-b880-288c10bc3f27" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:22:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5b44c1e8-3684-4aca-8ce0-acd1ac6b7cca tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-682044b2-e3ef-434e-b880-288c10bc3f27" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:22:28 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-5b44c1e8-3684-4aca-8ce0-acd1ac6b7cca tempest-GroupSnapshotsTest-478537237 None] Deleting offline snapshot 682044b2-e3ef-434e-b880-288c10bc3f27 of volume 02166d61-25e6-485e-9f5e-7f27a0e950d4 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:22:28 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-5b44c1e8-3684-4aca-8ce0-acd1ac6b7cca tempest-GroupSnapshotsTest-478537237 None] snapshot_file for this snap is: volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:22:28 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff128784-b34d-423a-8f68-1ff0f7aa724a]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5b44c1e8-3684-4aca-8ce0-acd1ac6b7cca tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:29 devstack sudo[101716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27
Sep 16 16:22:29 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:29 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5b44c1e8-3684-4aca-8ce0-acd1ac6b7cca tempest-GroupSnapshotsTest-478537237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27" returned: 0 in 0.415s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-5b44c1e8-3684-4aca-8ce0-acd1ac6b7cca tempest-GroupSnapshotsTest-478537237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02166d61-25e6-485e-9f5e-7f27a0e950d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:22:29 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af169b3-952e-4863-aebb-8b578888313a]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5b44c1e8-3684-4aca-8ce0-acd1ac6b7cca tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:29 devstack sudo[101723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4
Sep 16 16:22:29 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:29 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5b44c1e8-3684-4aca-8ce0-acd1ac6b7cca tempest-GroupSnapshotsTest-478537237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4" returned: 0 in 0.558s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5b44c1e8-3684-4aca-8ce0-acd1ac6b7cca tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:29 devstack sudo[101728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27
Sep 16 16:22:29 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:30 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5b44c1e8-3684-4aca-8ce0-acd1ac6b7cca tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27" returned: 0 in 0.417s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5b44c1e8-3684-4aca-8ce0-acd1ac6b7cca tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:30 devstack sudo[101734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27
Sep 16 16:22:30 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:30 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5b44c1e8-3684-4aca-8ce0-acd1ac6b7cca tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4.682044b2-e3ef-434e-b880-288c10bc3f27" returned: 0 in 0.268s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5b44c1e8-3684-4aca-8ce0-acd1ac6b7cca tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-682044b2-e3ef-434e-b880-288c10bc3f27" released by "_delete_snapshot" :: held 1.771s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5b44c1e8-3684-4aca-8ce0-acd1ac6b7cca tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-02166d61-25e6-485e-9f5e-7f27a0e950d4" released by "delete_snapshot" :: held 1.798s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:30 devstack cinder-volume[86165]: WARNING cinder.quota [None req-5b44c1e8-3684-4aca-8ce0-acd1ac6b7cca tempest-GroupSnapshotsTest-478537237 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-466002633 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-466002633, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:22:30 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-5b44c1e8-3684-4aca-8ce0-acd1ac6b7cca tempest-GroupSnapshotsTest-478537237 None] Created reservations ['0f2cecdf-ee5c-47d3-9c7a-2ddb29ff5123', '7245bd94-9cba-4c3e-a6ab-c679afc84287', '9a6d8d59-b4fe-43cb-9d80-dc784819008f', '4b8b8c28-641d-4463-bc08-4e0460f1ae8a'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:22:30 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-5b44c1e8-3684-4aca-8ce0-acd1ac6b7cca tempest-GroupSnapshotsTest-478537237 None] group_snapshot d33b62b0-f35f-4b4e-b4a2-c955699d69f9: deleted successfully
Sep 16 16:22:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-02a8aaad-592f-488d-8318-d5dcadaacfad tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "cinder-quobyte-02166d61-25e6-485e-9f5e-7f27a0e950d4" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:22:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-02a8aaad-592f-488d-8318-d5dcadaacfad tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-02166d61-25e6-485e-9f5e-7f27a0e950d4" acquired by "delete_volume" :: waited 0.021s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:22:31 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4478a082-0e70-4366-a9ae-cfb3008d245b]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02a8aaad-592f-488d-8318-d5dcadaacfad tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:31 devstack sudo[101738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4
Sep 16 16:22:31 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:31 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02a8aaad-592f-488d-8318-d5dcadaacfad tempest-GroupSnapshotsTest-478537237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4" returned: 0 in 0.389s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02a8aaad-592f-488d-8318-d5dcadaacfad tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:31 devstack sudo[101743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4
Sep 16 16:22:31 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:32 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02a8aaad-592f-488d-8318-d5dcadaacfad tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-02166d61-25e6-485e-9f5e-7f27a0e950d4" returned: 0 in 0.236s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-02a8aaad-592f-488d-8318-d5dcadaacfad tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-02166d61-25e6-485e-9f5e-7f27a0e950d4" released by "delete_volume" :: held 0.700s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:32 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-02a8aaad-592f-488d-8318-d5dcadaacfad tempest-GroupSnapshotsTest-478537237 None] Created reservations ['3ae6ac67-ec91-4006-b9ab-eab932f61cce'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:22:32 devstack cinder-volume[86165]: WARNING cinder.db.api [None req-02a8aaad-592f-488d-8318-d5dcadaacfad tempest-GroupSnapshotsTest-478537237 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-466002633']
Sep 16 16:22:32 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-02a8aaad-592f-488d-8318-d5dcadaacfad tempest-GroupSnapshotsTest-478537237 None] Created reservations ['4378fe2c-2169-4352-afe8-d404368a48fb', 'e4546b34-f177-472c-8fdd-a8bbf61e0aa6', 'd6af548b-4116-4862-aaf2-1741ca140158', '8f58c8a7-5321-4511-9cb4-bc34a7b10e0c'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:22:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-02a8aaad-592f-488d-8318-d5dcadaacfad tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-02a8aaad-592f-488d-8318-d5dcadaacfad tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-02a8aaad-592f-488d-8318-d5dcadaacfad tempest-GroupSnapshotsTest-478537237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:22:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-02a8aaad-592f-488d-8318-d5dcadaacfad tempest-GroupSnapshotsTest-478537237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:22:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-02a8aaad-592f-488d-8318-d5dcadaacfad tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02a8aaad-592f-488d-8318-d5dcadaacfad tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:32 devstack sudo[101746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:22:32 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:32 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02a8aaad-592f-488d-8318-d5dcadaacfad tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.234s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:32 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-02a8aaad-592f-488d-8318-d5dcadaacfad tempest-GroupSnapshotsTest-478537237 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:22:32 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-02a8aaad-592f-488d-8318-d5dcadaacfad tempest-GroupSnapshotsTest-478537237 None] Delete group completed successfully.
Sep 16 16:22:32 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-910fc7b8-df47-448a-9f9d-220d5130108b tempest-GroupSnapshotsTest-478537237 None] Group tempest-GroupSnapshotsTest-Group-2134948087: creating
Sep 16 16:22:32 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-910fc7b8-df47-448a-9f9d-220d5130108b tempest-GroupSnapshotsTest-478537237 None] Group tempest-GroupSnapshotsTest-Group-2134948087: created successfully
Sep 16 16:22:33 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-910fc7b8-df47-448a-9f9d-220d5130108b tempest-GroupSnapshotsTest-478537237 None] Create group completed successfully.
Sep 16 16:22:34 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:22:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Flow 'volume_create_manager' (8f02ec5e-8da2-46fd-8ef6-f067fe975fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:22:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e785ae9b-ac27-4c01-a7b0-61fb74cae48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e785ae9b-ac27-4c01-a7b0-61fb74cae48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-746713019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ecfb6342-64a2-47fc-a50e-8a2eafc26c40,host='devstack@QuobyteHD#QuobyteHD',id=1ef10d7c-2f60-419c-aec0-98e84430fb29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc28de8620f34ba1a5b997e9a6b24dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:35Z,use_quota=True,user_id='00262b1fca0e4c56a69ab1a9a672964f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5b17bdf-15a9-4565-9b1f-189402630abe),volume_type_id=c5b17bdf-15a9-4565-9b1f-189402630abe)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f624a752-c268-451f-9d49-028c76f78b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f624a752-c268-451f-9d49-028c76f78b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee07a8eb-7d9f-43cd-bc2e-625a84473881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee07a8eb-7d9f-43cd-bc2e-625a84473881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ef10d7c-2f60-419c-aec0-98e84430fb29', 'volume_name': 'volume-1ef10d7c-2f60-419c-aec0-98e84430fb29', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f954f7c-2b97-4af2-bbaf-1e2453946739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f954f7c-2b97-4af2-bbaf-1e2453946739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9879ec-2f55-40a1-87ea-df964bc9b129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:34 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Volume 1ef10d7c-2f60-419c-aec0-98e84430fb29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ef10d7c-2f60-419c-aec0-98e84430fb29', 'volume_size': 1}
Sep 16 16:22:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ecfb6342-64a2-47fc-a50e-8a2eafc26c40,created_at=2026-09-16T14:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-746713019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ecfb6342-64a2-47fc-a50e-8a2eafc26c40,host='devstack@QuobyteHD#QuobyteHD',id=1ef10d7c-2f60-419c-aec0-98e84430fb29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc28de8620f34ba1a5b997e9a6b24dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:35Z,use_quota=True,user_id='00262b1fca0e4c56a69ab1a9a672964f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5b17bdf-15a9-4565-9b1f-189402630abe),volume_type_id=c5b17bdf-15a9-4565-9b1f-189402630abe)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:22:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Creating volume 1ef10d7c-2f60-419c-aec0-98e84430fb29 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:22:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:22:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:22:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:22:34 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:22:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:34 devstack sudo[101749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29 1073741824
Sep 16 16:22:34 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:35 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29 1073741824" returned: 0 in 0.429s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:35 devstack sudo[101754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29
Sep 16 16:22:35 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:35 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29" returned: 0 in 0.261s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:22:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9879ec-2f55-40a1-87ea-df964bc9b129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ef10d7c-2f60-419c-aec0-98e84430fb29', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e78fd0-fa0c-4043-a7cf-d166edd4d6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:35 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Volume volume-1ef10d7c-2f60-419c-aec0-98e84430fb29 (1ef10d7c-2f60-419c-aec0-98e84430fb29): created successfully
Sep 16 16:22:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e78fd0-fa0c-4043-a7cf-d166edd4d6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Flow 'volume_create_manager' (8f02ec5e-8da2-46fd-8ef6-f067fe975fbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:22:35 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-95cada89-57f2-4bef-b40b-024ad8351e99 tempest-GroupSnapshotsTest-478537237 None] Created volume successfully.
Sep 16 16:22:36 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:22:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Flow 'volume_create_manager' (69ae0854-782c-4b39-96b4-991668e12adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:22:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6341a5b-7985-405e-84b0-ea65c24a2ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6341a5b-7985-405e-84b0-ea65c24a2ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-249001472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ecfb6342-64a2-47fc-a50e-8a2eafc26c40,host='devstack@QuobyteHD#QuobyteHD',id=a016e626-12bd-48b0-b8c6-dfe9ee93bb59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc28de8620f34ba1a5b997e9a6b24dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:36Z,use_quota=True,user_id='00262b1fca0e4c56a69ab1a9a672964f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5b17bdf-15a9-4565-9b1f-189402630abe),volume_type_id=c5b17bdf-15a9-4565-9b1f-189402630abe)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10c5490-53e5-4044-b6a1-09a63917afbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10c5490-53e5-4044-b6a1-09a63917afbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d52f30-e488-4ce0-83c0-0308344a9b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d52f30-e488-4ce0-83c0-0308344a9b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a016e626-12bd-48b0-b8c6-dfe9ee93bb59', 'volume_name': 'volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf343f7-5f95-462a-a8f6-d9e7296e36c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf343f7-5f95-462a-a8f6-d9e7296e36c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e3b09e-86d2-499b-ad09-01f6e6477ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:36 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Volume a016e626-12bd-48b0-b8c6-dfe9ee93bb59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59', 'volume_size': 1}
Sep 16 16:22:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ecfb6342-64a2-47fc-a50e-8a2eafc26c40,created_at=2026-09-16T14:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-249001472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ecfb6342-64a2-47fc-a50e-8a2eafc26c40,host='devstack@QuobyteHD#QuobyteHD',id=a016e626-12bd-48b0-b8c6-dfe9ee93bb59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc28de8620f34ba1a5b997e9a6b24dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:36Z,use_quota=True,user_id='00262b1fca0e4c56a69ab1a9a672964f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5b17bdf-15a9-4565-9b1f-189402630abe),volume_type_id=c5b17bdf-15a9-4565-9b1f-189402630abe)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:22:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Creating volume a016e626-12bd-48b0-b8c6-dfe9ee93bb59 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:22:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:22:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:22:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:22:36 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:22:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:36 devstack sudo[101757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59 1073741824
Sep 16 16:22:36 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:37 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59 1073741824" returned: 0 in 0.441s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:37 devstack sudo[101763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59
Sep 16 16:22:37 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:37 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59" returned: 0 in 0.245s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:22:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e3b09e-86d2-499b-ad09-01f6e6477ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8206d70d-17fd-4f23-a781-3973907b3bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:37 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Volume volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59 (a016e626-12bd-48b0-b8c6-dfe9ee93bb59): created successfully
Sep 16 16:22:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8206d70d-17fd-4f23-a781-3973907b3bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Flow 'volume_create_manager' (69ae0854-782c-4b39-96b4-991668e12adc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:22:37 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-3161dbb3-24a6-4006-96bd-c9d15025a262 tempest-GroupSnapshotsTest-478537237 None] Created volume successfully.
Sep 16 16:22:37 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-2136666d-10d9-402b-a8b1-a70a68760c9c tempest-GroupSnapshotsTest-478537237 None] Update group completed successfully.
Sep 16 16:22:38 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-08a1a848-eebb-4729-a3f7-7e2db47a03e6 tempest-GroupSnapshotsTest-478537237 None] Update group completed successfully.
Sep 16 16:22:40 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-faebb9c9-6ea5-4996-8901-cfc54bd3080c tempest-GroupSnapshotsTest-478537237 None] Update group completed successfully.
Sep 16 16:22:41 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-11139fa3-1da3-4126-a7f1-fd668432b76c tempest-GroupSnapshotsTest-478537237 None] Update group completed successfully.
Sep 16 16:22:42 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] GroupSnapshot 3078c118-d2bd-4e58-bb1c-5163c4b844ef: creating.
Sep 16 16:22:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] Group snapshot 3078c118-d2bd-4e58-bb1c-5163c4b844ef: creating. {{(pid=86165) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 16 16:22:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:42 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] Creating offline snapshot 0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc of volume 1ef10d7c-2f60-419c-aec0-98e84430fb29 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:22:42 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b842b616-81df-40ab-bff1-3c4d792e82b0]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:42 devstack sudo[101770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29
Sep 16 16:22:42 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:43 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29" returned: 0 in 0.359s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:43 devstack sudo[101775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc 1G
Sep 16 16:22:43 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:43 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc 1G" returned: 0 in 0.410s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ef10d7c-2f60-419c-aec0-98e84430fb29 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:43 devstack sudo[101780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ef10d7c-2f60-419c-aec0-98e84430fb29 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc
Sep 16 16:22:43 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:43 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ef10d7c-2f60-419c-aec0-98e84430fb29 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc" returned: 0 in 0.315s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:43 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 16:22:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:43 devstack sudo[101785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc
Sep 16 16:22:43 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:44 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc" returned: 0 in 0.242s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:44 devstack sudo[101788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.info
Sep 16 16:22:44 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:44 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.info" returned: 0 in 0.272s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:44 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 16:22:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:44 devstack sudo[101791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.info
Sep 16 16:22:44 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:44 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.info" returned: 0 in 0.268s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.950s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] Creating offline snapshot 844d56f2-b48e-4ac3-be98-efbf85b2c09e of volume a016e626-12bd-48b0-b8c6-dfe9ee93bb59 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:22:44 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef34098a-1af0-479d-9a1f-fbf54042a772]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:44 devstack sudo[101794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59
Sep 16 16:22:44 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:45 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59" returned: 0 in 0.348s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.844d56f2-b48e-4ac3-be98-efbf85b2c09e 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:45 devstack sudo[101799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.844d56f2-b48e-4ac3-be98-efbf85b2c09e 1G
Sep 16 16:22:45 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:45 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.844d56f2-b48e-4ac3-be98-efbf85b2c09e 1G" returned: 0 in 0.389s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.844d56f2-b48e-4ac3-be98-efbf85b2c09e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:45 devstack sudo[101805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.844d56f2-b48e-4ac3-be98-efbf85b2c09e
Sep 16 16:22:45 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:45 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.844d56f2-b48e-4ac3-be98-efbf85b2c09e" returned: 0 in 0.313s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:45 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.844d56f2-b48e-4ac3-be98-efbf85b2c09e is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 16:22:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.844d56f2-b48e-4ac3-be98-efbf85b2c09e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:45 devstack sudo[101810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.844d56f2-b48e-4ac3-be98-efbf85b2c09e
Sep 16 16:22:45 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:46 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.844d56f2-b48e-4ac3-be98-efbf85b2c09e" returned: 0 in 0.240s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:46 devstack sudo[101813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.info
Sep 16 16:22:46 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:46 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.info" returned: 0 in 0.266s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:46 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 16:22:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:46 devstack sudo[101816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.info
Sep 16 16:22:46 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:46 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.info" returned: 0 in 0.267s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.921s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:46 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-02c59aa9-402b-4e04-b09e-21ba0725ba37 tempest-GroupSnapshotsTest-478537237 None] group_snapshot 3078c118-d2bd-4e58-bb1c-5163c4b844ef: created successfully
Sep 16 16:22:47 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] group_snapshot 3078c118-d2bd-4e58-bb1c-5163c4b844ef: deleting
Sep 16 16:22:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] group_snapshot 3078c118-d2bd-4e58-bb1c-5163c4b844ef: deleting {{(pid=86165) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 16 16:22:47 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "cinder-quobyte-1ef10d7c-2f60-419c-aec0-98e84430fb29" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:22:47 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-1ef10d7c-2f60-419c-aec0-98e84430fb29" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:22:47 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "cinder-quobyte-0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:22:47 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:22:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Deleting offline snapshot 0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc of volume 1ef10d7c-2f60-419c-aec0-98e84430fb29 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:22:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] snapshot_file for this snap is: volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:22:47 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b27a52-4b72-4af6-adc9-56e0c6bde3d3]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:47 devstack sudo[101819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc
Sep 16 16:22:47 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:47 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc" returned: 0 in 0.415s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ef10d7c-2f60-419c-aec0-98e84430fb29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:22:47 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bdb05b-4bc3-4bd6-9878-9329f320fbde]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:47 devstack sudo[101825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29
Sep 16 16:22:47 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:48 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29" returned: 0 in 0.373s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:48 devstack sudo[101830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc
Sep 16 16:22:48 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:48 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc" returned: 0 in 0.343s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:48 devstack sudo[101835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc
Sep 16 16:22:48 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:48 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29.0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc" returned: 0 in 0.257s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-0e4f5702-18f1-42a7-895d-e4c6c3aa7bcc" released by "_delete_snapshot" :: held 1.498s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-1ef10d7c-2f60-419c-aec0-98e84430fb29" released by "delete_snapshot" :: held 1.519s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "cinder-quobyte-a016e626-12bd-48b0-b8c6-dfe9ee93bb59" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:22:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-a016e626-12bd-48b0-b8c6-dfe9ee93bb59" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:22:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "cinder-quobyte-844d56f2-b48e-4ac3-be98-efbf85b2c09e" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:22:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-844d56f2-b48e-4ac3-be98-efbf85b2c09e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:22:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Deleting offline snapshot 844d56f2-b48e-4ac3-be98-efbf85b2c09e of volume a016e626-12bd-48b0-b8c6-dfe9ee93bb59 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:22:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] snapshot_file for this snap is: volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.844d56f2-b48e-4ac3-be98-efbf85b2c09e {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:22:48 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f723a8b9-7750-43cc-8349-ce216ddbe1ad]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.844d56f2-b48e-4ac3-be98-efbf85b2c09e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:48 devstack sudo[101838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.844d56f2-b48e-4ac3-be98-efbf85b2c09e
Sep 16 16:22:48 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:49 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.844d56f2-b48e-4ac3-be98-efbf85b2c09e" returned: 0 in 0.371s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:22:49 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbec0936-9751-49c0-8576-06193f99096a]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:49 devstack sudo[101843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59
Sep 16 16:22:49 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:49 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59" returned: 0 in 0.363s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.844d56f2-b48e-4ac3-be98-efbf85b2c09e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:49 devstack sudo[101848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.844d56f2-b48e-4ac3-be98-efbf85b2c09e
Sep 16 16:22:49 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:49 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.844d56f2-b48e-4ac3-be98-efbf85b2c09e" returned: 0 in 0.328s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.844d56f2-b48e-4ac3-be98-efbf85b2c09e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:49 devstack sudo[101854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.844d56f2-b48e-4ac3-be98-efbf85b2c09e
Sep 16 16:22:49 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:50 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59.844d56f2-b48e-4ac3-be98-efbf85b2c09e" returned: 0 in 0.249s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-844d56f2-b48e-4ac3-be98-efbf85b2c09e" released by "_delete_snapshot" :: held 1.411s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-a016e626-12bd-48b0-b8c6-dfe9ee93bb59" released by "delete_snapshot" :: held 1.433s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:50 devstack cinder-volume[86165]: WARNING cinder.quota [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1088432840 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1088432840, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:22:50 devstack cinder-volume[86165]: WARNING cinder.quota [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1088432840 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1088432840, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:22:50 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Created reservations ['59728bd5-4a65-4b41-99db-9561fad7419f', '8a9f8c04-7a2e-447c-bec4-8d6f681cffae', '2b1763eb-07cd-46ba-a529-35d91a20e37b', '1758f8e9-692c-400c-ba82-1c16004e6df7'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:22:50 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] Created reservations ['7b90b739-4f0b-436e-9e38-18df44632230', '738eac50-15e6-4be3-b777-bc4a0cfbe486', '418f1fa1-8962-47ec-9406-260608677776', '06ff1d3b-9a5a-44e1-8f62-28c7fab0347a'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:22:50 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c236cd8e-9340-4c52-8e4e-2fe2568001be tempest-GroupSnapshotsTest-478537237 None] group_snapshot 3078c118-d2bd-4e58-bb1c-5163c4b844ef: deleted successfully
Sep 16 16:22:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "cinder-quobyte-1ef10d7c-2f60-419c-aec0-98e84430fb29" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:22:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-1ef10d7c-2f60-419c-aec0-98e84430fb29" acquired by "delete_volume" :: waited 0.013s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:22:50 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1185fb-2ae3-4406-92f5-73c1d9c2f2d9]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:51 devstack sudo[101858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29
Sep 16 16:22:51 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:51 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29" returned: 0 in 0.381s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:51 devstack sudo[101863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29
Sep 16 16:22:51 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:51 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1ef10d7c-2f60-419c-aec0-98e84430fb29" returned: 0 in 0.246s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:51 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-1ef10d7c-2f60-419c-aec0-98e84430fb29" released by "delete_volume" :: held 0.691s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:51 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "cinder-quobyte-a016e626-12bd-48b0-b8c6-dfe9ee93bb59" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:22:51 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-a016e626-12bd-48b0-b8c6-dfe9ee93bb59" acquired by "delete_volume" :: waited 0.018s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:22:51 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[773e95e0-bad9-40d8-8d80-c833485aafa8]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:51 devstack sudo[101866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59
Sep 16 16:22:51 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:52 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59" returned: 0 in 0.372s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:52 devstack sudo[101871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59
Sep 16 16:22:52 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:52 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-a016e626-12bd-48b0-b8c6-dfe9ee93bb59" returned: 0 in 0.258s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:52 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-a016e626-12bd-48b0-b8c6-dfe9ee93bb59" released by "delete_volume" :: held 0.690s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:22:52 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] Created reservations ['64ffbaa9-1153-47de-b425-966f71551994'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:22:52 devstack cinder-volume[86165]: WARNING cinder.quota [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1088432840 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1088432840, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:22:52 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] Created reservations ['4a9bac70-3bf7-49a7-b399-ef0c60741d89', '7665f2c4-1991-4759-aa35-497aa365a9e4', '954d12bb-771d-4d8f-9f89-7b290534e875', '0f90be21-f8da-4c11-8468-7a584f711869'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:22:52 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] Created reservations ['93855b15-67c6-4704-bfac-52f258b1afb1', '619dee1e-b555-4555-859a-53f26b6a2c56', '63a7a9cf-d97f-4926-b360-f3d14421ad66', '30e4bd8c-3083-49a5-b8bd-200d3baed43c'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:22:52 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=139,cinder:INSERT=34,cinder:UPDATE=129,cinder:DELETE=5 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:22:52 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=111,cinder:INSERT=32,cinder:UPDATE=130,cinder:DELETE=6 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:22:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:22:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:22:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:52 devstack sudo[101874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:22:52 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:52 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.261s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:52 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:22:52 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-44c80348-1816-4c6f-a82e-54f433e507ad tempest-GroupSnapshotsTest-478537237 None] Delete group completed successfully.
Sep 16 16:22:53 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-e82e3d5f-4b1e-4eb1-964d-5b8308383584 tempest-GroupSnapshotsTest-478537237 None] Group tempest-GroupSnapshotsTest-Group-1481776406: creating
Sep 16 16:22:53 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-e82e3d5f-4b1e-4eb1-964d-5b8308383584 tempest-GroupSnapshotsTest-478537237 None] Group tempest-GroupSnapshotsTest-Group-1481776406: created successfully
Sep 16 16:22:53 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-e82e3d5f-4b1e-4eb1-964d-5b8308383584 tempest-GroupSnapshotsTest-478537237 None] Create group completed successfully.
Sep 16 16:22:55 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:22:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Flow 'volume_create_manager' (26da87ad-6b78-4ad9-8794-1521069609e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:22:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528f2ac9-744b-4ff3-9dbf-8b70fdbd3e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528f2ac9-744b-4ff3-9dbf-8b70fdbd3e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-541288024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1a8073b9-b8cb-4b8a-a988-aa8714968822,host='devstack@QuobyteHD#QuobyteHD',id=4d798ea4-b158-4989-a1d0-0b4cfa7e838a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc28de8620f34ba1a5b997e9a6b24dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:55Z,use_quota=True,user_id='00262b1fca0e4c56a69ab1a9a672964f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(168bf9a7-2486-470c-84fb-e665f8519b79),volume_type_id=168bf9a7-2486-470c-84fb-e665f8519b79)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438144fb-7fb3-4bcf-b146-e59729a6c3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438144fb-7fb3-4bcf-b146-e59729a6c3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e32c826-5e24-4167-a842-9189c76f113d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e32c826-5e24-4167-a842-9189c76f113d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d798ea4-b158-4989-a1d0-0b4cfa7e838a', 'volume_name': 'volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1b7645-8e73-499c-a846-a5ce4f60ba11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1b7645-8e73-499c-a846-a5ce4f60ba11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108f0fae-00bb-4ca4-8337-542b553212f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:55 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Volume 4d798ea4-b158-4989-a1d0-0b4cfa7e838a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a', 'volume_size': 1}
Sep 16 16:22:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:55 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1a8073b9-b8cb-4b8a-a988-aa8714968822,created_at=2026-09-16T14:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-541288024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1a8073b9-b8cb-4b8a-a988-aa8714968822,host='devstack@QuobyteHD#QuobyteHD',id=4d798ea4-b158-4989-a1d0-0b4cfa7e838a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc28de8620f34ba1a5b997e9a6b24dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:55Z,use_quota=True,user_id='00262b1fca0e4c56a69ab1a9a672964f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(168bf9a7-2486-470c-84fb-e665f8519b79),volume_type_id=168bf9a7-2486-470c-84fb-e665f8519b79)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:22:55 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Creating volume 4d798ea4-b158-4989-a1d0-0b4cfa7e838a {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:22:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:55 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:22:55 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:22:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:55 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:22:55 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:22:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:55 devstack sudo[101878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a 1073741824
Sep 16 16:22:55 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:56 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a 1073741824" returned: 0 in 0.472s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:56 devstack sudo[101884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a
Sep 16 16:22:56 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:56 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a" returned: 0 in 0.266s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:22:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108f0fae-00bb-4ca4-8337-542b553212f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3edd38e8-f0f4-4496-99a1-87a6f70fc9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:22:56 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Volume volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a (4d798ea4-b158-4989-a1d0-0b4cfa7e838a): created successfully
Sep 16 16:22:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3edd38e8-f0f4-4496-99a1-87a6f70fc9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:22:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Flow 'volume_create_manager' (26da87ad-6b78-4ad9-8794-1521069609e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:22:56 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-d2061bac-69a2-422e-a257-98fe9e5f3d53 tempest-GroupSnapshotsTest-478537237 None] Created volume successfully.
Sep 16 16:22:56 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-0e18da80-bcb5-42a5-95ef-8441fdb28fb6 tempest-GroupSnapshotsTest-478537237 None] GroupSnapshot c51d2396-422f-4e8e-bc72-f3cf91a44d6b: creating.
Sep 16 16:22:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0e18da80-bcb5-42a5-95ef-8441fdb28fb6 tempest-GroupSnapshotsTest-478537237 None] Group snapshot c51d2396-422f-4e8e-bc72-f3cf91a44d6b: creating. {{(pid=86165) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 16 16:22:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0e18da80-bcb5-42a5-95ef-8441fdb28fb6 tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:22:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0e18da80-bcb5-42a5-95ef-8441fdb28fb6 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:22:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-0e18da80-bcb5-42a5-95ef-8441fdb28fb6 tempest-GroupSnapshotsTest-478537237 None] Creating offline snapshot 87a6825b-cbfe-4f29-8e8b-39006fe832a3 of volume 4d798ea4-b158-4989-a1d0-0b4cfa7e838a {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:22:56 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[200db0d4-2ed1-40ea-bc06-e3ac141b90c8]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:22:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0e18da80-bcb5-42a5-95ef-8441fdb28fb6 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:57 devstack sudo[101887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a
Sep 16 16:22:57 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:57 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0e18da80-bcb5-42a5-95ef-8441fdb28fb6 tempest-GroupSnapshotsTest-478537237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a" returned: 0 in 0.400s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0e18da80-bcb5-42a5-95ef-8441fdb28fb6 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.87a6825b-cbfe-4f29-8e8b-39006fe832a3 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:57 devstack sudo[101892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.87a6825b-cbfe-4f29-8e8b-39006fe832a3 1G
Sep 16 16:22:57 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:57 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0e18da80-bcb5-42a5-95ef-8441fdb28fb6 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.87a6825b-cbfe-4f29-8e8b-39006fe832a3 1G" returned: 0 in 0.438s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0e18da80-bcb5-42a5-95ef-8441fdb28fb6 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.87a6825b-cbfe-4f29-8e8b-39006fe832a3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:57 devstack sudo[101897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.87a6825b-cbfe-4f29-8e8b-39006fe832a3
Sep 16 16:22:57 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:58 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0e18da80-bcb5-42a5-95ef-8441fdb28fb6 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.87a6825b-cbfe-4f29-8e8b-39006fe832a3" returned: 0 in 0.303s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:58 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-0e18da80-bcb5-42a5-95ef-8441fdb28fb6 tempest-GroupSnapshotsTest-478537237 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.87a6825b-cbfe-4f29-8e8b-39006fe832a3 is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 16:22:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0e18da80-bcb5-42a5-95ef-8441fdb28fb6 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.87a6825b-cbfe-4f29-8e8b-39006fe832a3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:58 devstack sudo[101902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.87a6825b-cbfe-4f29-8e8b-39006fe832a3
Sep 16 16:22:58 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:58 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0e18da80-bcb5-42a5-95ef-8441fdb28fb6 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.87a6825b-cbfe-4f29-8e8b-39006fe832a3" returned: 0 in 0.283s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0e18da80-bcb5-42a5-95ef-8441fdb28fb6 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:58 devstack sudo[101905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.info
Sep 16 16:22:58 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:58 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0e18da80-bcb5-42a5-95ef-8441fdb28fb6 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.info" returned: 0 in 0.316s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:58 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-0e18da80-bcb5-42a5-95ef-8441fdb28fb6 tempest-GroupSnapshotsTest-478537237 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 16 16:22:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0e18da80-bcb5-42a5-95ef-8441fdb28fb6 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:22:58 devstack sudo[101908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.info
Sep 16 16:22:58 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:22:59 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root
Sep 16 16:22:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0e18da80-bcb5-42a5-95ef-8441fdb28fb6 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.info" returned: 0 in 0.257s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:22:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0e18da80-bcb5-42a5-95ef-8441fdb28fb6 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:22:59 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-0e18da80-bcb5-42a5-95ef-8441fdb28fb6 tempest-GroupSnapshotsTest-478537237 None] group_snapshot c51d2396-422f-4e8e-bc72-f3cf91a44d6b: created successfully
Sep 16 16:23:00 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] group_snapshot c51d2396-422f-4e8e-bc72-f3cf91a44d6b: deleting
Sep 16 16:23:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] group_snapshot c51d2396-422f-4e8e-bc72-f3cf91a44d6b: deleting {{(pid=86165) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 16 16:23:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "cinder-quobyte-4d798ea4-b158-4989-a1d0-0b4cfa7e838a" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:23:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-4d798ea4-b158-4989-a1d0-0b4cfa7e838a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:23:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "cinder-quobyte-87a6825b-cbfe-4f29-8e8b-39006fe832a3" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:23:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-87a6825b-cbfe-4f29-8e8b-39006fe832a3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:23:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] Deleting offline snapshot 87a6825b-cbfe-4f29-8e8b-39006fe832a3 of volume 4d798ea4-b158-4989-a1d0-0b4cfa7e838a {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:23:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] snapshot_file for this snap is: volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.87a6825b-cbfe-4f29-8e8b-39006fe832a3 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:23:00 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b201e654-92d7-4ece-84ba-6f564b1f533d]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:23:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.87a6825b-cbfe-4f29-8e8b-39006fe832a3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:00 devstack sudo[101911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.87a6825b-cbfe-4f29-8e8b-39006fe832a3
Sep 16 16:23:00 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:00 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.87a6825b-cbfe-4f29-8e8b-39006fe832a3" returned: 0 in 0.409s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:23:00 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5119d35-1a6c-4b83-b453-0d734e121e9e]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:23:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:01 devstack sudo[101917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a
Sep 16 16:23:01 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:01 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a" returned: 0 in 0.385s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.87a6825b-cbfe-4f29-8e8b-39006fe832a3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:01 devstack sudo[101922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.87a6825b-cbfe-4f29-8e8b-39006fe832a3
Sep 16 16:23:01 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:01 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.87a6825b-cbfe-4f29-8e8b-39006fe832a3" returned: 0 in 0.334s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.87a6825b-cbfe-4f29-8e8b-39006fe832a3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:01 devstack sudo[101928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.87a6825b-cbfe-4f29-8e8b-39006fe832a3
Sep 16 16:23:01 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:01 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a.87a6825b-cbfe-4f29-8e8b-39006fe832a3" returned: 0 in 0.253s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:01 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-87a6825b-cbfe-4f29-8e8b-39006fe832a3" released by "_delete_snapshot" :: held 1.506s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:23:01 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-4d798ea4-b158-4989-a1d0-0b4cfa7e838a" released by "delete_snapshot" :: held 1.530s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:23:02 devstack cinder-volume[86165]: WARNING cinder.quota [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-287728084 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-287728084, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:23:02 devstack cinder-volume[86165]: WARNING cinder.quota [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-287728084 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-287728084, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:23:02 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] Created reservations ['31f5fda7-0f3c-4ef4-86bc-a453f228ee62', '0d71ae42-3460-4c65-a012-d9985fd92773', '9927b176-21a4-4033-a5b9-ba4f66939d4a', '99e76c35-7d7a-4cef-aacb-0269c5c880bc'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:23:02 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c5f00834-ba6d-4342-ac15-7abea54b8e56 tempest-GroupSnapshotsTest-478537237 None] group_snapshot c51d2396-422f-4e8e-bc72-f3cf91a44d6b: deleted successfully
Sep 16 16:23:03 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-41c8c06b-e692-4e54-bd2f-aea0cd972ca5 tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "cinder-quobyte-4d798ea4-b158-4989-a1d0-0b4cfa7e838a" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:23:03 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-41c8c06b-e692-4e54-bd2f-aea0cd972ca5 tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-4d798ea4-b158-4989-a1d0-0b4cfa7e838a" acquired by "delete_volume" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:23:03 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8f7f07-62e2-482d-b260-7f05c6368423]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:23:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-41c8c06b-e692-4e54-bd2f-aea0cd972ca5 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:03 devstack sudo[101968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a
Sep 16 16:23:03 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:03 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-41c8c06b-e692-4e54-bd2f-aea0cd972ca5 tempest-GroupSnapshotsTest-478537237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a" returned: 0 in 0.406s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-41c8c06b-e692-4e54-bd2f-aea0cd972ca5 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:03 devstack sudo[101973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a
Sep 16 16:23:03 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:03 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-41c8c06b-e692-4e54-bd2f-aea0cd972ca5 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4d798ea4-b158-4989-a1d0-0b4cfa7e838a" returned: 0 in 0.298s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:03 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-41c8c06b-e692-4e54-bd2f-aea0cd972ca5 tempest-GroupSnapshotsTest-478537237 None] Lock "cinder-quobyte-4d798ea4-b158-4989-a1d0-0b4cfa7e838a" released by "delete_volume" :: held 0.774s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:23:03 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-41c8c06b-e692-4e54-bd2f-aea0cd972ca5 tempest-GroupSnapshotsTest-478537237 None] Created reservations ['7274a81c-22fb-42a0-9355-bafff2fee8b3'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:23:03 devstack cinder-volume[86165]: WARNING cinder.quota [None req-41c8c06b-e692-4e54-bd2f-aea0cd972ca5 tempest-GroupSnapshotsTest-478537237 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-287728084 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-287728084, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:23:03 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-41c8c06b-e692-4e54-bd2f-aea0cd972ca5 tempest-GroupSnapshotsTest-478537237 None] Created reservations ['2c4c0265-a136-4bc1-9ba7-1171903939b0', '22beb7e1-c82f-4254-aaeb-08d84263d061', '813e81dd-0177-4dd2-9c33-3fefd76a7f82', '500c9679-3983-4c08-9ba0-1ea0dd0eb88e'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:23:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-41c8c06b-e692-4e54-bd2f-aea0cd972ca5 tempest-GroupSnapshotsTest-478537237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-41c8c06b-e692-4e54-bd2f-aea0cd972ca5 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:04 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-41c8c06b-e692-4e54-bd2f-aea0cd972ca5 tempest-GroupSnapshotsTest-478537237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:23:04 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-41c8c06b-e692-4e54-bd2f-aea0cd972ca5 tempest-GroupSnapshotsTest-478537237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:23:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-41c8c06b-e692-4e54-bd2f-aea0cd972ca5 tempest-GroupSnapshotsTest-478537237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-41c8c06b-e692-4e54-bd2f-aea0cd972ca5 tempest-GroupSnapshotsTest-478537237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:04 devstack sudo[101976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:23:04 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:04 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-41c8c06b-e692-4e54-bd2f-aea0cd972ca5 tempest-GroupSnapshotsTest-478537237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.267s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:04 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-41c8c06b-e692-4e54-bd2f-aea0cd972ca5 tempest-GroupSnapshotsTest-478537237 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:23:04 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-41c8c06b-e692-4e54-bd2f-aea0cd972ca5 tempest-GroupSnapshotsTest-478537237 None] Delete group completed successfully.
Sep 16 16:23:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:23:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:23:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:23:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:07 devstack sudo[101979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:23:07 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:07 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.273s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:23:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:23:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 29 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:23:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>, <Thread(tpool_thread_0, started daemon 135438770624192)>, <Thread(tpool_thread_1, started daemon 135438762231488)>, <Thread(tpool_thread_2, started daemon 135438753838784)>, <Thread(tpool_thread_3, started daemon 135438745446080)>, <Thread(tpool_thread_4, started daemon 135438737053376)>, <Thread(tpool_thread_5, started daemon 135438728660672)>, <Thread(tpool_thread_6, started daemon 135438720267968)>, <Thread(tpool_thread_7, started daemon 135438711875264)>, <Thread(tpool_thread_8, started daemon 135438703466176)>, <Thread(tpool_thread_9, started daemon 135438695057088)>, <Thread(tpool_thread_10, started daemon 135438686648000)>, <Thread(tpool_thread_11, started daemon 135438678238912)>, <Thread(tpool_thread_12, started daemon 135438669829824)>, <Thread(tpool_thread_13, started daemon 135438661420736)>, <Thread(tpool_thread_14, started daemon 135438653011648)>, <Thread(tpool_thread_15, started daemon 135438644602560)>, <Thread(tpool_thread_16, started daemon 135438636193472)>, <Thread(tpool_thread_17, started daemon 135438627784384)>, <Thread(tpool_thread_18, started daemon 135438619375296)>, <Thread(tpool_thread_19, started daemon 135438610966208)>, <Thread(Rabbit-heartbeat, started daemon 135438772197760)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:23:10 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-7015470f-2664-4c8a-b76b-5560d6d4747c tempest-GroupsTest-1824438807 None] Group tempest-Group1-1475240319: creating
Sep 16 16:23:10 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-7015470f-2664-4c8a-b76b-5560d6d4747c tempest-GroupsTest-1824438807 None] Group tempest-Group1-1475240319: created successfully
Sep 16 16:23:10 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-7015470f-2664-4c8a-b76b-5560d6d4747c tempest-GroupsTest-1824438807 None] Create group completed successfully.
Sep 16 16:23:11 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-2333d129-82ee-42b6-ac06-4ee2871c7ef6 tempest-GroupsTest-1824438807 None] Group tempest-Group2-1017479434: creating
Sep 16 16:23:11 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-2333d129-82ee-42b6-ac06-4ee2871c7ef6 tempest-GroupsTest-1824438807 None] Group tempest-Group2-1017479434: created successfully
Sep 16 16:23:11 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-2333d129-82ee-42b6-ac06-4ee2871c7ef6 tempest-GroupsTest-1824438807 None] Create group completed successfully.
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Flow 'volume_create_manager' (74ed4505-0240-42c4-86a9-6723d4586191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9246ca-a644-4520-a348-be8908150e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9246ca-a644-4520-a348-be8908150e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-225012523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=95f326d2-e57e-4c03-bfa0-bebd8e30ee89,host='devstack@QuobyteHD#QuobyteHD',id=5de29cc9-2df3-49ec-a66c-a61ccc0dbf13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3310de1b3ffe4ac2bd97f7f30f0b0487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:13Z,use_quota=True,user_id='23c196fdd76e40d2b42254bfcd0d2ecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f5a7f6f-ca68-4736-898c-41c3669d33d8),volume_type_id=0f5a7f6f-ca68-4736-898c-41c3669d33d8)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339375bb-840f-47cd-9cb1-eb2c198fd994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339375bb-840f-47cd-9cb1-eb2c198fd994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17c8a81-24aa-4218-9e6e-26b8d729bdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17c8a81-24aa-4218-9e6e-26b8d729bdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5de29cc9-2df3-49ec-a66c-a61ccc0dbf13', 'volume_name': 'volume-5de29cc9-2df3-49ec-a66c-a61ccc0dbf13', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263703c4-0470-4b41-b875-646ee1482a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263703c4-0470-4b41-b875-646ee1482a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82eda654-db36-41d8-9961-847e4447131c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:13 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Volume 5de29cc9-2df3-49ec-a66c-a61ccc0dbf13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5de29cc9-2df3-49ec-a66c-a61ccc0dbf13', 'volume_size': 1}
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=95f326d2-e57e-4c03-bfa0-bebd8e30ee89,created_at=2026-09-16T14:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-225012523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=95f326d2-e57e-4c03-bfa0-bebd8e30ee89,host='devstack@QuobyteHD#QuobyteHD',id=5de29cc9-2df3-49ec-a66c-a61ccc0dbf13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3310de1b3ffe4ac2bd97f7f30f0b0487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:13Z,use_quota=True,user_id='23c196fdd76e40d2b42254bfcd0d2ecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f5a7f6f-ca68-4736-898c-41c3669d33d8),volume_type_id=0f5a7f6f-ca68-4736-898c-41c3669d33d8)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Creating volume 5de29cc9-2df3-49ec-a66c-a61ccc0dbf13 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:23:13 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5de29cc9-2df3-49ec-a66c-a61ccc0dbf13 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:13 devstack sudo[101989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5de29cc9-2df3-49ec-a66c-a61ccc0dbf13 1073741824
Sep 16 16:23:13 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:13 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5de29cc9-2df3-49ec-a66c-a61ccc0dbf13 1073741824" returned: 0 in 0.462s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5de29cc9-2df3-49ec-a66c-a61ccc0dbf13 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:13 devstack sudo[101995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5de29cc9-2df3-49ec-a66c-a61ccc0dbf13
Sep 16 16:23:13 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:14 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5de29cc9-2df3-49ec-a66c-a61ccc0dbf13" returned: 0 in 0.270s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:23:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82eda654-db36-41d8-9961-847e4447131c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5de29cc9-2df3-49ec-a66c-a61ccc0dbf13', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee02c428-dd39-4f2d-8b8a-44c0546455fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:14 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Volume volume-5de29cc9-2df3-49ec-a66c-a61ccc0dbf13 (5de29cc9-2df3-49ec-a66c-a61ccc0dbf13): created successfully
Sep 16 16:23:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee02c428-dd39-4f2d-8b8a-44c0546455fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Flow 'volume_create_manager' (74ed4505-0240-42c4-86a9-6723d4586191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:23:14 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-5dad69ae-8afb-43d1-874f-a711f7776f0b tempest-GroupsTest-1824438807 None] Created volume successfully.
Sep 16 16:23:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cfa64fd1-a66c-48fd-a463-c0167f08c6b6 tempest-GroupsTest-1824438807 None] Acquiring lock "cinder-quobyte-5de29cc9-2df3-49ec-a66c-a61ccc0dbf13" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:23:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cfa64fd1-a66c-48fd-a463-c0167f08c6b6 tempest-GroupsTest-1824438807 None] Lock "cinder-quobyte-5de29cc9-2df3-49ec-a66c-a61ccc0dbf13" acquired by "delete_volume" :: waited 0.015s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:23:15 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b258731d-3c8b-4bd2-a178-2a379b5de377]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:23:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cfa64fd1-a66c-48fd-a463-c0167f08c6b6 tempest-GroupsTest-1824438807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5de29cc9-2df3-49ec-a66c-a61ccc0dbf13 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:15 devstack sudo[101998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5de29cc9-2df3-49ec-a66c-a61ccc0dbf13
Sep 16 16:23:15 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:15 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cfa64fd1-a66c-48fd-a463-c0167f08c6b6 tempest-GroupsTest-1824438807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5de29cc9-2df3-49ec-a66c-a61ccc0dbf13" returned: 0 in 0.352s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cfa64fd1-a66c-48fd-a463-c0167f08c6b6 tempest-GroupsTest-1824438807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5de29cc9-2df3-49ec-a66c-a61ccc0dbf13 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:15 devstack sudo[102003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5de29cc9-2df3-49ec-a66c-a61ccc0dbf13
Sep 16 16:23:15 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:15 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cfa64fd1-a66c-48fd-a463-c0167f08c6b6 tempest-GroupsTest-1824438807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5de29cc9-2df3-49ec-a66c-a61ccc0dbf13" returned: 0 in 0.242s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cfa64fd1-a66c-48fd-a463-c0167f08c6b6 tempest-GroupsTest-1824438807 None] Lock "cinder-quobyte-5de29cc9-2df3-49ec-a66c-a61ccc0dbf13" released by "delete_volume" :: held 0.639s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:23:15 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-cfa64fd1-a66c-48fd-a463-c0167f08c6b6 tempest-GroupsTest-1824438807 None] Created reservations ['2e1ed96a-1caf-4882-808c-03ca4e668fe6'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:23:15 devstack cinder-volume[86165]: WARNING cinder.quota [None req-cfa64fd1-a66c-48fd-a463-c0167f08c6b6 tempest-GroupsTest-1824438807 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-102238791 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-102238791, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:23:15 devstack cinder-volume[86165]: WARNING cinder.quota [None req-cfa64fd1-a66c-48fd-a463-c0167f08c6b6 tempest-GroupsTest-1824438807 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-102238791 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-102238791, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:23:15 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-cfa64fd1-a66c-48fd-a463-c0167f08c6b6 tempest-GroupsTest-1824438807 None] Created reservations ['90679cb8-6c09-4e77-b577-5dc9505251bc', 'c5225b8c-f5ba-49ba-b1db-78c941dd87f6', 'b456cc88-6d2a-4ede-9eaf-7eeb8d4accef', '6f86ec15-1635-476c-9886-fc85bb62d9f4'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:23:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cfa64fd1-a66c-48fd-a463-c0167f08c6b6 tempest-GroupsTest-1824438807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cfa64fd1-a66c-48fd-a463-c0167f08c6b6 tempest-GroupsTest-1824438807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-cfa64fd1-a66c-48fd-a463-c0167f08c6b6 tempest-GroupsTest-1824438807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:23:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-cfa64fd1-a66c-48fd-a463-c0167f08c6b6 tempest-GroupsTest-1824438807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:23:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cfa64fd1-a66c-48fd-a463-c0167f08c6b6 tempest-GroupsTest-1824438807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cfa64fd1-a66c-48fd-a463-c0167f08c6b6 tempest-GroupsTest-1824438807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:15 devstack sudo[102006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:23:15 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:16 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cfa64fd1-a66c-48fd-a463-c0167f08c6b6 tempest-GroupsTest-1824438807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.230s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:16 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-cfa64fd1-a66c-48fd-a463-c0167f08c6b6 tempest-GroupsTest-1824438807 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:23:16 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-cfa64fd1-a66c-48fd-a463-c0167f08c6b6 tempest-GroupsTest-1824438807 None] Delete group completed successfully.
Sep 16 16:23:16 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-9dda6d54-e59d-4aff-8a98-0232dd87f71f tempest-GroupsTest-1824438807 None] Created reservations ['f802f270-5bfe-420d-ae55-fd4395697519'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:23:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9dda6d54-e59d-4aff-8a98-0232dd87f71f tempest-GroupsTest-1824438807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9dda6d54-e59d-4aff-8a98-0232dd87f71f tempest-GroupsTest-1824438807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9dda6d54-e59d-4aff-8a98-0232dd87f71f tempest-GroupsTest-1824438807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:23:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9dda6d54-e59d-4aff-8a98-0232dd87f71f tempest-GroupsTest-1824438807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:23:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9dda6d54-e59d-4aff-8a98-0232dd87f71f tempest-GroupsTest-1824438807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9dda6d54-e59d-4aff-8a98-0232dd87f71f tempest-GroupsTest-1824438807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:16 devstack sudo[102009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:23:16 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:16 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9dda6d54-e59d-4aff-8a98-0232dd87f71f tempest-GroupsTest-1824438807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.240s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:16 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-9dda6d54-e59d-4aff-8a98-0232dd87f71f tempest-GroupsTest-1824438807 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:23:16 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-9dda6d54-e59d-4aff-8a98-0232dd87f71f tempest-GroupsTest-1824438807 None] Delete group completed successfully.
Sep 16 16:23:17 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-3e4d36b2-4700-488d-bdd0-7493125a2fe9 tempest-GroupsTest-1824438807 None] Group tempest-GroupsTest-Group-1273379336: creating
Sep 16 16:23:17 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-3e4d36b2-4700-488d-bdd0-7493125a2fe9 tempest-GroupsTest-1824438807 None] Group tempest-GroupsTest-Group-1273379336: created successfully
Sep 16 16:23:17 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-3e4d36b2-4700-488d-bdd0-7493125a2fe9 tempest-GroupsTest-1824438807 None] Create group completed successfully.
Sep 16 16:23:19 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:23:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Flow 'volume_create_manager' (c07ba4f2-70bb-418c-9c66-d316efd72b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:23:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0399ac14-6855-4cc8-9c2a-1ea48019da11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0399ac14-6855-4cc8-9c2a-1ea48019da11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1707610214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c823a2c7-1802-4e11-93c3-84f5c8b839ef,host='devstack@QuobyteHD#QuobyteHD',id=913985ec-15f2-4ef6-9bf1-35bb26336a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3310de1b3ffe4ac2bd97f7f30f0b0487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:20Z,use_quota=True,user_id='23c196fdd76e40d2b42254bfcd0d2ecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2197f687-43f0-4610-ae01-144cf2144cf4),volume_type_id=2197f687-43f0-4610-ae01-144cf2144cf4)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eafa0f1-96a7-4a3b-97da-c53c99723e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eafa0f1-96a7-4a3b-97da-c53c99723e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b56203-200d-4819-8f15-e1196e40c237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b56203-200d-4819-8f15-e1196e40c237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '913985ec-15f2-4ef6-9bf1-35bb26336a2e', 'volume_name': 'volume-913985ec-15f2-4ef6-9bf1-35bb26336a2e', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b75e6324-b632-4fc8-9461-765d474a63c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b75e6324-b632-4fc8-9461-765d474a63c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (228d2541-c62e-42a7-b441-663b10b054a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:19 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Volume 913985ec-15f2-4ef6-9bf1-35bb26336a2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-913985ec-15f2-4ef6-9bf1-35bb26336a2e', 'volume_size': 1}
Sep 16 16:23:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c823a2c7-1802-4e11-93c3-84f5c8b839ef,created_at=2026-09-16T14:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1707610214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c823a2c7-1802-4e11-93c3-84f5c8b839ef,host='devstack@QuobyteHD#QuobyteHD',id=913985ec-15f2-4ef6-9bf1-35bb26336a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3310de1b3ffe4ac2bd97f7f30f0b0487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:20Z,use_quota=True,user_id='23c196fdd76e40d2b42254bfcd0d2ecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2197f687-43f0-4610-ae01-144cf2144cf4),volume_type_id=2197f687-43f0-4610-ae01-144cf2144cf4)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:23:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Creating volume 913985ec-15f2-4ef6-9bf1-35bb26336a2e {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:23:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:23:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:23:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:23:19 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:23:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-913985ec-15f2-4ef6-9bf1-35bb26336a2e 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:19 devstack sudo[102012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-913985ec-15f2-4ef6-9bf1-35bb26336a2e 1073741824
Sep 16 16:23:19 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:20 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-913985ec-15f2-4ef6-9bf1-35bb26336a2e 1073741824" returned: 0 in 0.459s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-913985ec-15f2-4ef6-9bf1-35bb26336a2e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:20 devstack sudo[102017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-913985ec-15f2-4ef6-9bf1-35bb26336a2e
Sep 16 16:23:20 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:20 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-913985ec-15f2-4ef6-9bf1-35bb26336a2e" returned: 0 in 0.257s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:23:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (228d2541-c62e-42a7-b441-663b10b054a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-913985ec-15f2-4ef6-9bf1-35bb26336a2e', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7e3ef8-0160-4b14-86f3-419cf6b24de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:20 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Volume volume-913985ec-15f2-4ef6-9bf1-35bb26336a2e (913985ec-15f2-4ef6-9bf1-35bb26336a2e): created successfully
Sep 16 16:23:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7e3ef8-0160-4b14-86f3-419cf6b24de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Flow 'volume_create_manager' (c07ba4f2-70bb-418c-9c66-d316efd72b3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:23:20 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-461b0b19-8985-4987-8dfc-0cecff0e974b tempest-GroupsTest-1824438807 None] Created volume successfully.
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Flow 'volume_create_manager' (b3501cc5-4784-405e-b833-984f388b2bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c783f1e-2a45-4f5c-b54f-82a4e3660ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c783f1e-2a45-4f5c-b54f-82a4e3660ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-380817169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c823a2c7-1802-4e11-93c3-84f5c8b839ef,host='devstack@QuobyteHD#QuobyteHD',id=8bbaf5c3-b917-40f5-964d-0cc03b60a783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3310de1b3ffe4ac2bd97f7f30f0b0487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:21Z,use_quota=True,user_id='23c196fdd76e40d2b42254bfcd0d2ecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2197f687-43f0-4610-ae01-144cf2144cf4),volume_type_id=2197f687-43f0-4610-ae01-144cf2144cf4)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31492853-c56b-42e1-83da-18c85a29cc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31492853-c56b-42e1-83da-18c85a29cc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3120de5-2743-4cca-bad3-40e4e5357172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3120de5-2743-4cca-bad3-40e4e5357172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bbaf5c3-b917-40f5-964d-0cc03b60a783', 'volume_name': 'volume-8bbaf5c3-b917-40f5-964d-0cc03b60a783', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a5914f-799b-4747-a681-fe09d3491b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a5914f-799b-4747-a681-fe09d3491b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b186757-edcc-40c0-be92-36787f9f5bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:21 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Volume 8bbaf5c3-b917-40f5-964d-0cc03b60a783: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bbaf5c3-b917-40f5-964d-0cc03b60a783', 'volume_size': 1}
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c823a2c7-1802-4e11-93c3-84f5c8b839ef,created_at=2026-09-16T14:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-380817169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c823a2c7-1802-4e11-93c3-84f5c8b839ef,host='devstack@QuobyteHD#QuobyteHD',id=8bbaf5c3-b917-40f5-964d-0cc03b60a783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3310de1b3ffe4ac2bd97f7f30f0b0487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:21Z,use_quota=True,user_id='23c196fdd76e40d2b42254bfcd0d2ecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2197f687-43f0-4610-ae01-144cf2144cf4),volume_type_id=2197f687-43f0-4610-ae01-144cf2144cf4)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Creating volume 8bbaf5c3-b917-40f5-964d-0cc03b60a783 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:23:21 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8bbaf5c3-b917-40f5-964d-0cc03b60a783 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:21 devstack sudo[102021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8bbaf5c3-b917-40f5-964d-0cc03b60a783 1073741824
Sep 16 16:23:21 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:21 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8bbaf5c3-b917-40f5-964d-0cc03b60a783 1073741824" returned: 0 in 0.437s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8bbaf5c3-b917-40f5-964d-0cc03b60a783 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:21 devstack sudo[102026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8bbaf5c3-b917-40f5-964d-0cc03b60a783
Sep 16 16:23:21 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:22 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8bbaf5c3-b917-40f5-964d-0cc03b60a783" returned: 0 in 0.256s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:23:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b186757-edcc-40c0-be92-36787f9f5bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bbaf5c3-b917-40f5-964d-0cc03b60a783', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ff51c4-70ca-4b8c-87bb-2906bda54daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:22 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Volume volume-8bbaf5c3-b917-40f5-964d-0cc03b60a783 (8bbaf5c3-b917-40f5-964d-0cc03b60a783): created successfully
Sep 16 16:23:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ff51c4-70ca-4b8c-87bb-2906bda54daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Flow 'volume_create_manager' (b3501cc5-4784-405e-b833-984f388b2bbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:23:22 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-12247670-3d0a-4c3c-b975-a49a5c7806fd tempest-GroupsTest-1824438807 None] Created volume successfully.
Sep 16 16:23:22 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-98e12a22-4215-4641-9f86-27103b02c1ff tempest-GroupsTest-1824438807 None] Update group completed successfully.
Sep 16 16:23:24 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-fc465448-0284-4a3c-8000-2d7cb5190050 tempest-GroupsTest-1824438807 None] Update group completed successfully.
Sep 16 16:23:25 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Acquiring lock "cinder-quobyte-8bbaf5c3-b917-40f5-964d-0cc03b60a783" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:23:25 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Lock "cinder-quobyte-8bbaf5c3-b917-40f5-964d-0cc03b60a783" acquired by "delete_volume" :: waited 0.014s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:23:25 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd80d8d8-410b-4c7f-a2fc-9dd5c5b87531]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:23:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8bbaf5c3-b917-40f5-964d-0cc03b60a783 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:25 devstack sudo[102029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8bbaf5c3-b917-40f5-964d-0cc03b60a783
Sep 16 16:23:25 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:26 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8bbaf5c3-b917-40f5-964d-0cc03b60a783" returned: 0 in 0.347s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8bbaf5c3-b917-40f5-964d-0cc03b60a783 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:26 devstack sudo[102034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8bbaf5c3-b917-40f5-964d-0cc03b60a783
Sep 16 16:23:26 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:26 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-8bbaf5c3-b917-40f5-964d-0cc03b60a783" returned: 0 in 0.239s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Lock "cinder-quobyte-8bbaf5c3-b917-40f5-964d-0cc03b60a783" released by "delete_volume" :: held 0.634s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:23:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Acquiring lock "cinder-quobyte-913985ec-15f2-4ef6-9bf1-35bb26336a2e" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:23:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Lock "cinder-quobyte-913985ec-15f2-4ef6-9bf1-35bb26336a2e" acquired by "delete_volume" :: waited 0.013s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:23:26 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db94999-c384-478e-81da-da2d0c879484]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:23:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-913985ec-15f2-4ef6-9bf1-35bb26336a2e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:26 devstack sudo[102037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-913985ec-15f2-4ef6-9bf1-35bb26336a2e
Sep 16 16:23:26 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:26 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-913985ec-15f2-4ef6-9bf1-35bb26336a2e" returned: 0 in 0.355s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-913985ec-15f2-4ef6-9bf1-35bb26336a2e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:26 devstack sudo[102042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-913985ec-15f2-4ef6-9bf1-35bb26336a2e
Sep 16 16:23:26 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:26 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-913985ec-15f2-4ef6-9bf1-35bb26336a2e" returned: 0 in 0.281s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Lock "cinder-quobyte-913985ec-15f2-4ef6-9bf1-35bb26336a2e" released by "delete_volume" :: held 0.679s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:23:27 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Created reservations ['058cdc07-be08-409f-ab5c-78eb083ae3e5'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:23:27 devstack cinder-volume[86165]: WARNING cinder.quota [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2122891126 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2122891126, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:23:27 devstack cinder-volume[86165]: WARNING cinder.quota [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2122891126 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2122891126, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:23:27 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Created reservations ['90999bd2-d3da-4d07-8bcb-4db5cf3fb94f', 'b11b5e3c-f416-429b-933d-36c34ddd313a', '431a30c3-53e8-4b48-a320-ea9a59133b5f', '47f7eaea-2736-461b-82fa-4a61b340db8c'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:23:27 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Created reservations ['79a08389-a22c-4331-b334-c2037d519035', 'e662c516-d269-4f4c-b2a8-4a95596f1e2f', 'a401f3e9-2b6d-4323-b4ae-1e73bef62b7d', 'a87d5fde-b727-46fb-bb85-661dfdd25844'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:23:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:23:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:23:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:27 devstack sudo[102045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:23:27 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:27 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.264s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:27 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:23:27 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-83f4f555-fd08-4cb8-a531-38d4b9a82283 tempest-GroupsTest-1824438807 None] Delete group completed successfully.
Sep 16 16:23:34 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:23:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Flow 'volume_create_manager' (7f7e802b-80a4-4d08-ad06-df7b7f1e592d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:23:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35de5e6-ae3d-4859-8646-2226157f497f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35de5e6-ae3d-4859-8646-2226157f497f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1168208489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eddf150-5da6-49f5-9f08-1a7d15b90b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a7a0dc7e6c484588962afbe4735bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:34Z,use_quota=True,user_id='d9f8cce28e864756b5a21c5124402747',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1faf61-7595-4b3b-bff7-d879c1dc61c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1faf61-7595-4b3b-bff7-d879c1dc61c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4e8704-94a0-4323-afe5-20cd32445c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4e8704-94a0-4323-afe5-20cd32445c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eddf150-5da6-49f5-9f08-1a7d15b90b2d', 'volume_name': 'volume-2eddf150-5da6-49f5-9f08-1a7d15b90b2d', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4ed9ce-c80f-48f6-b339-6a3d41aa7145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4ed9ce-c80f-48f6-b339-6a3d41aa7145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5bf79ee-3d0e-46d6-be27-ffcff23ece07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:34 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Volume 2eddf150-5da6-49f5-9f08-1a7d15b90b2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eddf150-5da6-49f5-9f08-1a7d15b90b2d', 'volume_size': 1}
Sep 16 16:23:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1168208489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eddf150-5da6-49f5-9f08-1a7d15b90b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a7a0dc7e6c484588962afbe4735bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:34Z,use_quota=True,user_id='d9f8cce28e864756b5a21c5124402747',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:23:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Creating volume 2eddf150-5da6-49f5-9f08-1a7d15b90b2d {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:23:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:23:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:23:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:23:34 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:23:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2eddf150-5da6-49f5-9f08-1a7d15b90b2d 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:34 devstack sudo[102050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2eddf150-5da6-49f5-9f08-1a7d15b90b2d 1073741824
Sep 16 16:23:34 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:35 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2eddf150-5da6-49f5-9f08-1a7d15b90b2d 1073741824" returned: 0 in 0.421s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2eddf150-5da6-49f5-9f08-1a7d15b90b2d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:35 devstack sudo[102055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2eddf150-5da6-49f5-9f08-1a7d15b90b2d
Sep 16 16:23:35 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:35 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2eddf150-5da6-49f5-9f08-1a7d15b90b2d" returned: 0 in 0.250s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:23:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5bf79ee-3d0e-46d6-be27-ffcff23ece07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eddf150-5da6-49f5-9f08-1a7d15b90b2d', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a7cc242-ebd3-492e-84f2-be61cf0e1172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:35 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Volume volume-2eddf150-5da6-49f5-9f08-1a7d15b90b2d (2eddf150-5da6-49f5-9f08-1a7d15b90b2d): created successfully
Sep 16 16:23:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a7cc242-ebd3-492e-84f2-be61cf0e1172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Flow 'volume_create_manager' (7f7e802b-80a4-4d08-ad06-df7b7f1e592d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:23:35 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-49397fd7-a360-4ba7-a945-6092cb307799 tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Created volume successfully.
Sep 16 16:23:36 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-798b4d15-227d-4ada-874b-e53d48bae99a tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Acquiring lock "cinder-2eddf150-5da6-49f5-9f08-1a7d15b90b2d-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:23:36 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-798b4d15-227d-4ada-874b-e53d48bae99a tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Lock "cinder-2eddf150-5da6-49f5-9f08-1a7d15b90b2d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:23:36 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-798b4d15-227d-4ada-874b-e53d48bae99a tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Acquiring lock "cinder-quobyte-2eddf150-5da6-49f5-9f08-1a7d15b90b2d" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:23:36 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-798b4d15-227d-4ada-874b-e53d48bae99a tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Lock "cinder-quobyte-2eddf150-5da6-49f5-9f08-1a7d15b90b2d" acquired by "delete_volume" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:23:36 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[52055329-aa00-4e08-8beb-55b58e564c0c]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:23:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-798b4d15-227d-4ada-874b-e53d48bae99a tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2eddf150-5da6-49f5-9f08-1a7d15b90b2d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:36 devstack sudo[102058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2eddf150-5da6-49f5-9f08-1a7d15b90b2d
Sep 16 16:23:36 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:36 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-798b4d15-227d-4ada-874b-e53d48bae99a tempest-VolumeQuotasNegativeTestJSON-1380744784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2eddf150-5da6-49f5-9f08-1a7d15b90b2d" returned: 0 in 0.349s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-798b4d15-227d-4ada-874b-e53d48bae99a tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2eddf150-5da6-49f5-9f08-1a7d15b90b2d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:36 devstack sudo[102063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2eddf150-5da6-49f5-9f08-1a7d15b90b2d
Sep 16 16:23:36 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:37 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-798b4d15-227d-4ada-874b-e53d48bae99a tempest-VolumeQuotasNegativeTestJSON-1380744784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2eddf150-5da6-49f5-9f08-1a7d15b90b2d" returned: 0 in 0.240s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-798b4d15-227d-4ada-874b-e53d48bae99a tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Lock "cinder-quobyte-2eddf150-5da6-49f5-9f08-1a7d15b90b2d" released by "delete_volume" :: held 0.629s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:23:37 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-798b4d15-227d-4ada-874b-e53d48bae99a tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Created reservations ['1ca4527a-280d-40e6-bab1-d9d11c0653ef', '1581544f-0eb1-4c8a-ac61-1e833facf196', '1b13be4b-76e1-4675-837e-a33fb1d35a42', '7fc014b9-a0c7-4125-8bd7-a3a4ada2d2a6'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:23:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-798b4d15-227d-4ada-874b-e53d48bae99a tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-798b4d15-227d-4ada-874b-e53d48bae99a tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-798b4d15-227d-4ada-874b-e53d48bae99a tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:23:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-798b4d15-227d-4ada-874b-e53d48bae99a tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:23:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-798b4d15-227d-4ada-874b-e53d48bae99a tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-798b4d15-227d-4ada-874b-e53d48bae99a tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:37 devstack sudo[102067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:23:37 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:37 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-798b4d15-227d-4ada-874b-e53d48bae99a tempest-VolumeQuotasNegativeTestJSON-1380744784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.244s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:37 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-798b4d15-227d-4ada-874b-e53d48bae99a tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:23:37 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-798b4d15-227d-4ada-874b-e53d48bae99a tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Deleted volume successfully.
Sep 16 16:23:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-798b4d15-227d-4ada-874b-e53d48bae99a tempest-VolumeQuotasNegativeTestJSON-1380744784 None] Lock "cinder-2eddf150-5da6-49f5-9f08-1a7d15b90b2d-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:23:47 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=92,cinder:SELECT=75,cinder:INSERT=19,cinder:DELETE=2 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:23:47 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=73,cinder:UPDATE=78,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:23:48 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:23:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Flow 'volume_create_manager' (1fead51c-42c5-42fc-bfcb-5f1d1656eb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:23:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c130a338-6919-4320-8eba-12520a80fea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c130a338-6919-4320-8eba-12520a80fea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-355955266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86774e1b-0cb9-4e69-abcd-726c6cf6823a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a25c05d716b4b9dba64ed69b4d7949b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:49Z,use_quota=True,user_id='ff7d22127b224704b2dc1cd4f5580708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e773b166-9c1b-4941-8309-cd88ac429bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e773b166-9c1b-4941-8309-cd88ac429bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d989bcb-a9de-49b1-aad6-119dbcfbef0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d989bcb-a9de-49b1-aad6-119dbcfbef0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86774e1b-0cb9-4e69-abcd-726c6cf6823a', 'volume_name': 'volume-86774e1b-0cb9-4e69-abcd-726c6cf6823a', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7edaed-0727-4868-a797-1d4777c24726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7edaed-0727-4868-a797-1d4777c24726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dae373d-457b-4d23-bc50-4193f5fb5d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:49 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Volume 86774e1b-0cb9-4e69-abcd-726c6cf6823a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86774e1b-0cb9-4e69-abcd-726c6cf6823a', 'volume_size': 1}
Sep 16 16:23:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-355955266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86774e1b-0cb9-4e69-abcd-726c6cf6823a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a25c05d716b4b9dba64ed69b4d7949b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:49Z,use_quota=True,user_id='ff7d22127b224704b2dc1cd4f5580708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:23:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Creating volume 86774e1b-0cb9-4e69-abcd-726c6cf6823a {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:23:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:23:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:23:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:23:49 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:23:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-86774e1b-0cb9-4e69-abcd-726c6cf6823a 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:49 devstack sudo[102073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-86774e1b-0cb9-4e69-abcd-726c6cf6823a 1073741824
Sep 16 16:23:49 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:49 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-86774e1b-0cb9-4e69-abcd-726c6cf6823a 1073741824" returned: 0 in 0.476s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-86774e1b-0cb9-4e69-abcd-726c6cf6823a {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:49 devstack sudo[102079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-86774e1b-0cb9-4e69-abcd-726c6cf6823a
Sep 16 16:23:49 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:49 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-86774e1b-0cb9-4e69-abcd-726c6cf6823a" returned: 0 in 0.272s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:23:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dae373d-457b-4d23-bc50-4193f5fb5d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86774e1b-0cb9-4e69-abcd-726c6cf6823a', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e36a932-76a3-45f5-9a08-d810a081ffaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:49 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Volume volume-86774e1b-0cb9-4e69-abcd-726c6cf6823a (86774e1b-0cb9-4e69-abcd-726c6cf6823a): created successfully
Sep 16 16:23:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e36a932-76a3-45f5-9a08-d810a081ffaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Flow 'volume_create_manager' (1fead51c-42c5-42fc-bfcb-5f1d1656eb11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:23:49 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-ac559914-e3a6-4ada-9812-137ab64960a4 tempest-VolumesListAdminTestJSON-34382002 None] Created volume successfully.
Sep 16 16:23:51 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:23:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Flow 'volume_create_manager' (b8df01a6-40f5-47b0-9b8e-178488923b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:23:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c40102-1a96-4587-a601-0d8b6e62964a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c40102-1a96-4587-a601-0d8b6e62964a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-204149673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c275254e-c13d-49de-8159-809027068e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a25c05d716b4b9dba64ed69b4d7949b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:52Z,use_quota=True,user_id='ff7d22127b224704b2dc1cd4f5580708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d04b1e40-fa74-4d50-8ed7-c549cc610a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d04b1e40-fa74-4d50-8ed7-c549cc610a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e296e5e7-d4eb-499e-ad69-5f2b9772dc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e296e5e7-d4eb-499e-ad69-5f2b9772dc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c275254e-c13d-49de-8159-809027068e1c', 'volume_name': 'volume-c275254e-c13d-49de-8159-809027068e1c', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e67b1dcb-2780-487a-af75-b5f89f4ddd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e67b1dcb-2780-487a-af75-b5f89f4ddd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:51 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2be8332-7862-4a38-82fb-83a2143aff0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:51 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Volume c275254e-c13d-49de-8159-809027068e1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c275254e-c13d-49de-8159-809027068e1c', 'volume_size': 1}
Sep 16 16:23:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-204149673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c275254e-c13d-49de-8159-809027068e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a25c05d716b4b9dba64ed69b4d7949b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:52Z,use_quota=True,user_id='ff7d22127b224704b2dc1cd4f5580708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:23:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Creating volume c275254e-c13d-49de-8159-809027068e1c {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:23:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:23:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:23:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:23:51 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:23:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c275254e-c13d-49de-8159-809027068e1c 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:51 devstack sudo[102083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c275254e-c13d-49de-8159-809027068e1c 1073741824
Sep 16 16:23:51 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:52 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c275254e-c13d-49de-8159-809027068e1c 1073741824" returned: 0 in 0.464s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c275254e-c13d-49de-8159-809027068e1c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:52 devstack sudo[102089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c275254e-c13d-49de-8159-809027068e1c
Sep 16 16:23:52 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:52 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c275254e-c13d-49de-8159-809027068e1c" returned: 0 in 0.252s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:23:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2be8332-7862-4a38-82fb-83a2143aff0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c275254e-c13d-49de-8159-809027068e1c', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74697b62-4790-4849-bf60-b21b67d2ccb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:52 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Volume volume-c275254e-c13d-49de-8159-809027068e1c (c275254e-c13d-49de-8159-809027068e1c): created successfully
Sep 16 16:23:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74697b62-4790-4849-bf60-b21b67d2ccb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Flow 'volume_create_manager' (b8df01a6-40f5-47b0-9b8e-178488923b16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:23:52 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-d01cf011-3832-4696-940a-ff4118f9c57c tempest-VolumesListAdminTestJSON-34382002 None] Created volume successfully.
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Flow 'volume_create_manager' (81395829-6677-4402-ba45-35520baefeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e03f32-3653-4444-9656-d15c8476bd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e03f32-3653-4444-9656-d15c8476bd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2070255374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc1d96c-121f-44f6-8af1-d130d0b2d9c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a25c05d716b4b9dba64ed69b4d7949b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:54Z,use_quota=True,user_id='ff7d22127b224704b2dc1cd4f5580708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb9b61e-c663-412e-b93d-6f8d85da614c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb9b61e-c663-412e-b93d-6f8d85da614c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce04e26-f924-4a87-b255-68219ba51aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce04e26-f924-4a87-b255-68219ba51aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fc1d96c-121f-44f6-8af1-d130d0b2d9c3', 'volume_name': 'volume-1fc1d96c-121f-44f6-8af1-d130d0b2d9c3', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b90532-21a4-4c23-96a2-067e30602d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b90532-21a4-4c23-96a2-067e30602d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55fad953-d3b1-4b2b-940a-97de053c0fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:54 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Volume 1fc1d96c-121f-44f6-8af1-d130d0b2d9c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fc1d96c-121f-44f6-8af1-d130d0b2d9c3', 'volume_size': 1}
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2070255374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc1d96c-121f-44f6-8af1-d130d0b2d9c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a25c05d716b4b9dba64ed69b4d7949b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:54Z,use_quota=True,user_id='ff7d22127b224704b2dc1cd4f5580708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Creating volume 1fc1d96c-121f-44f6-8af1-d130d0b2d9c3 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:23:54 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1fc1d96c-121f-44f6-8af1-d130d0b2d9c3 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:54 devstack sudo[102093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1fc1d96c-121f-44f6-8af1-d130d0b2d9c3 1073741824
Sep 16 16:23:54 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:54 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1fc1d96c-121f-44f6-8af1-d130d0b2d9c3 1073741824" returned: 0 in 0.460s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1fc1d96c-121f-44f6-8af1-d130d0b2d9c3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:54 devstack sudo[102098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1fc1d96c-121f-44f6-8af1-d130d0b2d9c3
Sep 16 16:23:54 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:55 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1fc1d96c-121f-44f6-8af1-d130d0b2d9c3" returned: 0 in 0.262s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:55 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:23:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55fad953-d3b1-4b2b-940a-97de053c0fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fc1d96c-121f-44f6-8af1-d130d0b2d9c3', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafab42b-9fd5-4623-a6a3-d8d3b03a35fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:55 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Volume volume-1fc1d96c-121f-44f6-8af1-d130d0b2d9c3 (1fc1d96c-121f-44f6-8af1-d130d0b2d9c3): created successfully
Sep 16 16:23:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafab42b-9fd5-4623-a6a3-d8d3b03a35fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Flow 'volume_create_manager' (81395829-6677-4402-ba45-35520baefeca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:23:55 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-5cd5544d-8cd5-4cdb-a810-fab65f0648a7 tempest-VolumesListAdminTestJSON-34382002 None] Created volume successfully.
Sep 16 16:23:55 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Flow 'volume_create_manager' (78ee7bd1-97e9-4e5d-a413-badacf1c5aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9cd6266-f5a2-49a0-9396-0cb9c6ca874c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9cd6266-f5a2-49a0-9396-0cb9c6ca874c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d406fd49-cbe8-49f8-ab55-b64892749028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05d234dd492d4b48987143a59366713f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:56Z,use_quota=True,user_id='fbe606b548954d1798a51d9ee273d8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6514bd0c-8923-441a-8e96-308cd4364f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6514bd0c-8923-441a-8e96-308cd4364f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00f920f-4ed4-4964-98ae-5605f476589a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00f920f-4ed4-4964-98ae-5605f476589a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd406fd49-cbe8-49f8-ab55-b64892749028', 'volume_name': 'volume-d406fd49-cbe8-49f8-ab55-b64892749028', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b967a54-e471-42fa-a9c8-8ac2757b73fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b967a54-e471-42fa-a9c8-8ac2757b73fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c720ab-9148-4ffd-a4fd-7c68becc196c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:56 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Volume d406fd49-cbe8-49f8-ab55-b64892749028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d406fd49-cbe8-49f8-ab55-b64892749028', 'volume_size': 1}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d406fd49-cbe8-49f8-ab55-b64892749028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05d234dd492d4b48987143a59366713f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:56Z,use_quota=True,user_id='fbe606b548954d1798a51d9ee273d8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Creating volume d406fd49-cbe8-49f8-ab55-b64892749028 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:23:56 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d406fd49-cbe8-49f8-ab55-b64892749028 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:56 devstack sudo[102101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d406fd49-cbe8-49f8-ab55-b64892749028 1073741824
Sep 16 16:23:56 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:56 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d406fd49-cbe8-49f8-ab55-b64892749028 1073741824" returned: 0 in 0.508s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d406fd49-cbe8-49f8-ab55-b64892749028 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:56 devstack sudo[102106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d406fd49-cbe8-49f8-ab55-b64892749028
Sep 16 16:23:56 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:56 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d406fd49-cbe8-49f8-ab55-b64892749028" returned: 0 in 0.280s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c720ab-9148-4ffd-a4fd-7c68becc196c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d406fd49-cbe8-49f8-ab55-b64892749028', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a131b3d9-a6ac-44ce-a8c7-1bb1cf57938b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:23:56 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Volume volume-d406fd49-cbe8-49f8-ab55-b64892749028 (d406fd49-cbe8-49f8-ab55-b64892749028): created successfully
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a131b3d9-a6ac-44ce-a8c7-1bb1cf57938b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:23:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Flow 'volume_create_manager' (78ee7bd1-97e9-4e5d-a413-badacf1c5aa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:23:56 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-fa61165e-b427-441d-a48e-f5ade5889864 tempest-VolumesListAdminTestJSON-1241365472 None] Created volume successfully.
Sep 16 16:23:58 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-478d7e9b-e61b-44f1-953b-444eee1c4520 tempest-VolumesListAdminTestJSON-1241365472 None] Acquiring lock "cinder-d406fd49-cbe8-49f8-ab55-b64892749028-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:23:58 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-478d7e9b-e61b-44f1-953b-444eee1c4520 tempest-VolumesListAdminTestJSON-1241365472 None] Lock "cinder-d406fd49-cbe8-49f8-ab55-b64892749028-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:23:58 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-478d7e9b-e61b-44f1-953b-444eee1c4520 tempest-VolumesListAdminTestJSON-1241365472 None] Acquiring lock "cinder-quobyte-d406fd49-cbe8-49f8-ab55-b64892749028" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:23:58 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-478d7e9b-e61b-44f1-953b-444eee1c4520 tempest-VolumesListAdminTestJSON-1241365472 None] Lock "cinder-quobyte-d406fd49-cbe8-49f8-ab55-b64892749028" acquired by "delete_volume" :: waited 0.027s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:23:58 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db6eaee-6195-405e-83fe-113e709c4138]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:23:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-478d7e9b-e61b-44f1-953b-444eee1c4520 tempest-VolumesListAdminTestJSON-1241365472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d406fd49-cbe8-49f8-ab55-b64892749028 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:58 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-49b3090e-01f1-49a0-8ae3-e3ae6103f496 tempest-VolumesListAdminTestJSON-34382002 None] Acquiring lock "cinder-1fc1d96c-121f-44f6-8af1-d130d0b2d9c3-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:23:58 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-49b3090e-01f1-49a0-8ae3-e3ae6103f496 tempest-VolumesListAdminTestJSON-34382002 None] Lock "cinder-1fc1d96c-121f-44f6-8af1-d130d0b2d9c3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:23:58 devstack sudo[102109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d406fd49-cbe8-49f8-ab55-b64892749028
Sep 16 16:23:58 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:58 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-49b3090e-01f1-49a0-8ae3-e3ae6103f496 tempest-VolumesListAdminTestJSON-34382002 None] Acquiring lock "cinder-quobyte-1fc1d96c-121f-44f6-8af1-d130d0b2d9c3" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:23:58 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-49b3090e-01f1-49a0-8ae3-e3ae6103f496 tempest-VolumesListAdminTestJSON-34382002 None] Lock "cinder-quobyte-1fc1d96c-121f-44f6-8af1-d130d0b2d9c3" acquired by "delete_volume" :: waited 0.018s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:23:58 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bd0ee5-0047-4872-9497-b751642e393a]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:23:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-49b3090e-01f1-49a0-8ae3-e3ae6103f496 tempest-VolumesListAdminTestJSON-34382002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1fc1d96c-121f-44f6-8af1-d130d0b2d9c3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:58 devstack sudo[102111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1fc1d96c-121f-44f6-8af1-d130d0b2d9c3
Sep 16 16:23:58 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:58 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-478d7e9b-e61b-44f1-953b-444eee1c4520 tempest-VolumesListAdminTestJSON-1241365472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d406fd49-cbe8-49f8-ab55-b64892749028" returned: 0 in 0.436s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-478d7e9b-e61b-44f1-953b-444eee1c4520 tempest-VolumesListAdminTestJSON-1241365472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d406fd49-cbe8-49f8-ab55-b64892749028 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:58 devstack sudo[102116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d406fd49-cbe8-49f8-ab55-b64892749028
Sep 16 16:23:58 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:59 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-49b3090e-01f1-49a0-8ae3-e3ae6103f496 tempest-VolumesListAdminTestJSON-34382002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1fc1d96c-121f-44f6-8af1-d130d0b2d9c3" returned: 0 in 0.489s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-49b3090e-01f1-49a0-8ae3-e3ae6103f496 tempest-VolumesListAdminTestJSON-34382002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1fc1d96c-121f-44f6-8af1-d130d0b2d9c3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:59 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-478d7e9b-e61b-44f1-953b-444eee1c4520 tempest-VolumesListAdminTestJSON-1241365472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d406fd49-cbe8-49f8-ab55-b64892749028" returned: 0 in 0.266s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-478d7e9b-e61b-44f1-953b-444eee1c4520 tempest-VolumesListAdminTestJSON-1241365472 None] Lock "cinder-quobyte-d406fd49-cbe8-49f8-ab55-b64892749028" released by "delete_volume" :: held 0.771s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:23:59 devstack sudo[102122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1fc1d96c-121f-44f6-8af1-d130d0b2d9c3
Sep 16 16:23:59 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-478d7e9b-e61b-44f1-953b-444eee1c4520 tempest-VolumesListAdminTestJSON-1241365472 None] Created reservations ['f015e5df-6485-4551-8ed7-d4f9ee2abcaa', 'b720771b-bd84-43f2-9421-d540b573f5d3', '03805fa5-0a69-4230-a30c-cf75b53116e2', '8a4d3532-b8c7-4a3a-869b-e811b7f449b3'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-478d7e9b-e61b-44f1-953b-444eee1c4520 tempest-VolumesListAdminTestJSON-1241365472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-478d7e9b-e61b-44f1-953b-444eee1c4520 tempest-VolumesListAdminTestJSON-1241365472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-478d7e9b-e61b-44f1-953b-444eee1c4520 tempest-VolumesListAdminTestJSON-1241365472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-478d7e9b-e61b-44f1-953b-444eee1c4520 tempest-VolumesListAdminTestJSON-1241365472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-478d7e9b-e61b-44f1-953b-444eee1c4520 tempest-VolumesListAdminTestJSON-1241365472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-478d7e9b-e61b-44f1-953b-444eee1c4520 tempest-VolumesListAdminTestJSON-1241365472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:59 devstack sudo[102124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:23:59 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:59 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-49b3090e-01f1-49a0-8ae3-e3ae6103f496 tempest-VolumesListAdminTestJSON-34382002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1fc1d96c-121f-44f6-8af1-d130d0b2d9c3" returned: 0 in 0.288s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-49b3090e-01f1-49a0-8ae3-e3ae6103f496 tempest-VolumesListAdminTestJSON-34382002 None] Lock "cinder-quobyte-1fc1d96c-121f-44f6-8af1-d130d0b2d9c3" released by "delete_volume" :: held 0.836s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-49b3090e-01f1-49a0-8ae3-e3ae6103f496 tempest-VolumesListAdminTestJSON-34382002 None] Created reservations ['5a641e03-3a54-4aac-8471-3334d9ce1ed3', '8cf3179c-7a74-462f-b9ac-b79c85775b21', 'b47691ea-05df-4d29-973a-6aa2070a0c73', 'd499e380-5e50-4e7a-b415-906b74c87120'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-49b3090e-01f1-49a0-8ae3-e3ae6103f496 tempest-VolumesListAdminTestJSON-34382002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-49b3090e-01f1-49a0-8ae3-e3ae6103f496 tempest-VolumesListAdminTestJSON-34382002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-49b3090e-01f1-49a0-8ae3-e3ae6103f496 tempest-VolumesListAdminTestJSON-34382002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-49b3090e-01f1-49a0-8ae3-e3ae6103f496 tempest-VolumesListAdminTestJSON-34382002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-49b3090e-01f1-49a0-8ae3-e3ae6103f496 tempest-VolumesListAdminTestJSON-34382002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-49b3090e-01f1-49a0-8ae3-e3ae6103f496 tempest-VolumesListAdminTestJSON-34382002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:59 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-478d7e9b-e61b-44f1-953b-444eee1c4520 tempest-VolumesListAdminTestJSON-1241365472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.295s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-478d7e9b-e61b-44f1-953b-444eee1c4520 tempest-VolumesListAdminTestJSON-1241365472 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:23:59 devstack sudo[102128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:23:59 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:23:59 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-478d7e9b-e61b-44f1-953b-444eee1c4520 tempest-VolumesListAdminTestJSON-1241365472 None] Deleted volume successfully.
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-478d7e9b-e61b-44f1-953b-444eee1c4520 tempest-VolumesListAdminTestJSON-1241365472 None] Lock "cinder-d406fd49-cbe8-49f8-ab55-b64892749028-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-96084d77-e6a6-466c-9d5d-d28edb639620 tempest-VolumesListAdminTestJSON-34382002 None] Acquiring lock "cinder-c275254e-c13d-49de-8159-809027068e1c-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-96084d77-e6a6-466c-9d5d-d28edb639620 tempest-VolumesListAdminTestJSON-34382002 None] Lock "cinder-c275254e-c13d-49de-8159-809027068e1c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-96084d77-e6a6-466c-9d5d-d28edb639620 tempest-VolumesListAdminTestJSON-34382002 None] Acquiring lock "cinder-quobyte-c275254e-c13d-49de-8159-809027068e1c" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-96084d77-e6a6-466c-9d5d-d28edb639620 tempest-VolumesListAdminTestJSON-34382002 None] Lock "cinder-quobyte-c275254e-c13d-49de-8159-809027068e1c" acquired by "delete_volume" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7182a62-45f6-4ee4-b12c-0c53884d91fc]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-96084d77-e6a6-466c-9d5d-d28edb639620 tempest-VolumesListAdminTestJSON-34382002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c275254e-c13d-49de-8159-809027068e1c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:23:59 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-49b3090e-01f1-49a0-8ae3-e3ae6103f496 tempest-VolumesListAdminTestJSON-34382002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.338s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-49b3090e-01f1-49a0-8ae3-e3ae6103f496 tempest-VolumesListAdminTestJSON-34382002 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:23:59 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-49b3090e-01f1-49a0-8ae3-e3ae6103f496 tempest-VolumesListAdminTestJSON-34382002 None] Deleted volume successfully.
Sep 16 16:23:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-49b3090e-01f1-49a0-8ae3-e3ae6103f496 tempest-VolumesListAdminTestJSON-34382002 None] Lock "cinder-1fc1d96c-121f-44f6-8af1-d130d0b2d9c3-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:23:59 devstack sudo[102131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c275254e-c13d-49de-8159-809027068e1c
Sep 16 16:23:59 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:00 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-96084d77-e6a6-466c-9d5d-d28edb639620 tempest-VolumesListAdminTestJSON-34382002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c275254e-c13d-49de-8159-809027068e1c" returned: 0 in 0.376s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-96084d77-e6a6-466c-9d5d-d28edb639620 tempest-VolumesListAdminTestJSON-34382002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c275254e-c13d-49de-8159-809027068e1c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:00 devstack sudo[102136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c275254e-c13d-49de-8159-809027068e1c
Sep 16 16:24:00 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:00 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-96084d77-e6a6-466c-9d5d-d28edb639620 tempest-VolumesListAdminTestJSON-34382002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c275254e-c13d-49de-8159-809027068e1c" returned: 0 in 0.249s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-96084d77-e6a6-466c-9d5d-d28edb639620 tempest-VolumesListAdminTestJSON-34382002 None] Lock "cinder-quobyte-c275254e-c13d-49de-8159-809027068e1c" released by "delete_volume" :: held 0.669s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:24:00 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-96084d77-e6a6-466c-9d5d-d28edb639620 tempest-VolumesListAdminTestJSON-34382002 None] Created reservations ['c9c0b56c-68aa-40ae-9abb-7fb33d4de2cc', '3f9342cf-796c-43a5-8620-f9477a35bef9', '57b39dd7-289e-449a-989c-9dcc06210251', '8072aefc-eff0-4389-9825-5f25c1bfe709'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:24:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-96084d77-e6a6-466c-9d5d-d28edb639620 tempest-VolumesListAdminTestJSON-34382002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:24:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-96084d77-e6a6-466c-9d5d-d28edb639620 tempest-VolumesListAdminTestJSON-34382002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:24:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-96084d77-e6a6-466c-9d5d-d28edb639620 tempest-VolumesListAdminTestJSON-34382002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:24:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-96084d77-e6a6-466c-9d5d-d28edb639620 tempest-VolumesListAdminTestJSON-34382002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:24:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-96084d77-e6a6-466c-9d5d-d28edb639620 tempest-VolumesListAdminTestJSON-34382002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:24:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-96084d77-e6a6-466c-9d5d-d28edb639620 tempest-VolumesListAdminTestJSON-34382002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:00 devstack sudo[102139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:24:00 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:00 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-96084d77-e6a6-466c-9d5d-d28edb639620 tempest-VolumesListAdminTestJSON-34382002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.260s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:00 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-96084d77-e6a6-466c-9d5d-d28edb639620 tempest-VolumesListAdminTestJSON-34382002 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:24:00 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-96084d77-e6a6-466c-9d5d-d28edb639620 tempest-VolumesListAdminTestJSON-34382002 None] Deleted volume successfully.
Sep 16 16:24:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-96084d77-e6a6-466c-9d5d-d28edb639620 tempest-VolumesListAdminTestJSON-34382002 None] Lock "cinder-c275254e-c13d-49de-8159-809027068e1c-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:24:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bc53a74e-ea7e-4e5b-bbdd-1483d1103391 tempest-VolumesListAdminTestJSON-34382002 None] Acquiring lock "cinder-86774e1b-0cb9-4e69-abcd-726c6cf6823a-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:24:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bc53a74e-ea7e-4e5b-bbdd-1483d1103391 tempest-VolumesListAdminTestJSON-34382002 None] Lock "cinder-86774e1b-0cb9-4e69-abcd-726c6cf6823a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:24:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bc53a74e-ea7e-4e5b-bbdd-1483d1103391 tempest-VolumesListAdminTestJSON-34382002 None] Acquiring lock "cinder-quobyte-86774e1b-0cb9-4e69-abcd-726c6cf6823a" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:24:01 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bc53a74e-ea7e-4e5b-bbdd-1483d1103391 tempest-VolumesListAdminTestJSON-34382002 None] Lock "cinder-quobyte-86774e1b-0cb9-4e69-abcd-726c6cf6823a" acquired by "delete_volume" :: waited 0.015s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:24:01 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[de67c7c7-9d7e-411c-bc64-942858af2809]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:24:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bc53a74e-ea7e-4e5b-bbdd-1483d1103391 tempest-VolumesListAdminTestJSON-34382002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-86774e1b-0cb9-4e69-abcd-726c6cf6823a {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:01 devstack sudo[102143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-86774e1b-0cb9-4e69-abcd-726c6cf6823a
Sep 16 16:24:01 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:01 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bc53a74e-ea7e-4e5b-bbdd-1483d1103391 tempest-VolumesListAdminTestJSON-34382002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-86774e1b-0cb9-4e69-abcd-726c6cf6823a" returned: 0 in 0.377s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bc53a74e-ea7e-4e5b-bbdd-1483d1103391 tempest-VolumesListAdminTestJSON-34382002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-86774e1b-0cb9-4e69-abcd-726c6cf6823a {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:01 devstack sudo[102148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-86774e1b-0cb9-4e69-abcd-726c6cf6823a
Sep 16 16:24:01 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:01 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bc53a74e-ea7e-4e5b-bbdd-1483d1103391 tempest-VolumesListAdminTestJSON-34382002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-86774e1b-0cb9-4e69-abcd-726c6cf6823a" returned: 0 in 0.264s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:01 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bc53a74e-ea7e-4e5b-bbdd-1483d1103391 tempest-VolumesListAdminTestJSON-34382002 None] Lock "cinder-quobyte-86774e1b-0cb9-4e69-abcd-726c6cf6823a" released by "delete_volume" :: held 0.685s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:24:01 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-bc53a74e-ea7e-4e5b-bbdd-1483d1103391 tempest-VolumesListAdminTestJSON-34382002 None] Created reservations ['186021f2-bcce-4b81-9ff9-ebcf63cdbfee', '77c2415b-f32a-4a82-894a-75460518d82a', '70036849-c5df-4e8d-ae4d-8194ce43feac', '74d1065e-b65f-46cc-9a41-0c3f2d71fe19'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:24:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bc53a74e-ea7e-4e5b-bbdd-1483d1103391 tempest-VolumesListAdminTestJSON-34382002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:24:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bc53a74e-ea7e-4e5b-bbdd-1483d1103391 tempest-VolumesListAdminTestJSON-34382002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:24:01 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-bc53a74e-ea7e-4e5b-bbdd-1483d1103391 tempest-VolumesListAdminTestJSON-34382002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:24:01 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-bc53a74e-ea7e-4e5b-bbdd-1483d1103391 tempest-VolumesListAdminTestJSON-34382002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:24:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bc53a74e-ea7e-4e5b-bbdd-1483d1103391 tempest-VolumesListAdminTestJSON-34382002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:24:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bc53a74e-ea7e-4e5b-bbdd-1483d1103391 tempest-VolumesListAdminTestJSON-34382002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:01 devstack sudo[102151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:24:01 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:02 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bc53a74e-ea7e-4e5b-bbdd-1483d1103391 tempest-VolumesListAdminTestJSON-34382002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.283s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:02 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-bc53a74e-ea7e-4e5b-bbdd-1483d1103391 tempest-VolumesListAdminTestJSON-34382002 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:24:02 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-bc53a74e-ea7e-4e5b-bbdd-1483d1103391 tempest-VolumesListAdminTestJSON-34382002 None] Deleted volume successfully.
Sep 16 16:24:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bc53a74e-ea7e-4e5b-bbdd-1483d1103391 tempest-VolumesListAdminTestJSON-34382002 None] Lock "cinder-86774e1b-0cb9-4e69-abcd-726c6cf6823a-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:24:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:24:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:24:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:24:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:24:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:24:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:24:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:07 devstack sudo[102190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:24:07 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:07 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.255s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:24:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:24:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 29 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:24:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>, <Thread(tpool_thread_0, started daemon 135438770624192)>, <Thread(tpool_thread_1, started daemon 135438762231488)>, <Thread(tpool_thread_2, started daemon 135438753838784)>, <Thread(tpool_thread_3, started daemon 135438745446080)>, <Thread(tpool_thread_4, started daemon 135438737053376)>, <Thread(tpool_thread_5, started daemon 135438728660672)>, <Thread(tpool_thread_6, started daemon 135438720267968)>, <Thread(tpool_thread_7, started daemon 135438711875264)>, <Thread(tpool_thread_8, started daemon 135438703466176)>, <Thread(tpool_thread_9, started daemon 135438695057088)>, <Thread(tpool_thread_10, started daemon 135438686648000)>, <Thread(tpool_thread_11, started daemon 135438678238912)>, <Thread(tpool_thread_12, started daemon 135438669829824)>, <Thread(tpool_thread_13, started daemon 135438661420736)>, <Thread(tpool_thread_14, started daemon 135438653011648)>, <Thread(tpool_thread_15, started daemon 135438644602560)>, <Thread(tpool_thread_16, started daemon 135438636193472)>, <Thread(tpool_thread_17, started daemon 135438627784384)>, <Thread(tpool_thread_18, started daemon 135438619375296)>, <Thread(tpool_thread_19, started daemon 135438610966208)>, <Thread(Rabbit-heartbeat, started daemon 135438772197760)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:24:08 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:24:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Flow 'volume_create_manager' (6e39a3f3-dd71-4671-83c8-83cbef424da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:24:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d21394-d3f7-4d95-a7ef-c0f3325b0ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d21394-d3f7-4d95-a7ef-c0f3325b0ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1706049101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604dce1c-3e1e-4458-b215-e2bc5f35929d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147318c49d8943aaa4c7789075517241',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:24:08Z,use_quota=True,user_id='eca43e031cda46dcb037b259132fb760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc048949-db22-48e0-888e-df34a692b24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc048949-db22-48e0-888e-df34a692b24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cad85a5-ece7-465a-a7cc-e83011d61de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cad85a5-ece7-465a-a7cc-e83011d61de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '604dce1c-3e1e-4458-b215-e2bc5f35929d', 'volume_name': 'volume-604dce1c-3e1e-4458-b215-e2bc5f35929d', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b75d6e8-5cc1-4920-ac97-58ccc3f55e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b75d6e8-5cc1-4920-ac97-58ccc3f55e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6975c33-2457-4f9d-818c-c30903663572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:08 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Volume 604dce1c-3e1e-4458-b215-e2bc5f35929d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-604dce1c-3e1e-4458-b215-e2bc5f35929d', 'volume_size': 1}
Sep 16 16:24:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:24:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:24:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1706049101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604dce1c-3e1e-4458-b215-e2bc5f35929d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147318c49d8943aaa4c7789075517241',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:24:08Z,use_quota=True,user_id='eca43e031cda46dcb037b259132fb760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:24:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Creating volume 604dce1c-3e1e-4458-b215-e2bc5f35929d {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:24:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:24:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:24:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:24:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:24:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:24:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:24:08 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:24:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-604dce1c-3e1e-4458-b215-e2bc5f35929d 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:08 devstack sudo[102193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-604dce1c-3e1e-4458-b215-e2bc5f35929d 1073741824
Sep 16 16:24:08 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:09 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-604dce1c-3e1e-4458-b215-e2bc5f35929d 1073741824" returned: 0 in 0.418s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-604dce1c-3e1e-4458-b215-e2bc5f35929d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:09 devstack sudo[102198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-604dce1c-3e1e-4458-b215-e2bc5f35929d
Sep 16 16:24:09 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:09 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-604dce1c-3e1e-4458-b215-e2bc5f35929d" returned: 0 in 0.286s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:24:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:24:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6975c33-2457-4f9d-818c-c30903663572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-604dce1c-3e1e-4458-b215-e2bc5f35929d', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e088b54e-c61a-449c-b464-5f7c26cf9804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:09 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Volume volume-604dce1c-3e1e-4458-b215-e2bc5f35929d (604dce1c-3e1e-4458-b215-e2bc5f35929d): created successfully
Sep 16 16:24:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e088b54e-c61a-449c-b464-5f7c26cf9804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Flow 'volume_create_manager' (6e39a3f3-dd71-4671-83c8-83cbef424da3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:24:09 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c05a2e0b-eac3-4ffd-860f-b370d1a7d29e tempest-VolumesTransfersV355Test-1732798607 None] Created volume successfully.
Sep 16 16:24:10 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-dc6d3c68-71db-4ab0-b651-8b5a12ec93a2 tempest-VolumesTransfersV355Test-1214177224 None] Transfer volume completed successfully.
Sep 16 16:24:10 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-73e13ff3-4dc1-40f3-b6a2-d723a6ace8c0 tempest-VolumesTransfersV355Test-1651607790 None] Acquiring lock "cinder-604dce1c-3e1e-4458-b215-e2bc5f35929d-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:24:10 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-73e13ff3-4dc1-40f3-b6a2-d723a6ace8c0 tempest-VolumesTransfersV355Test-1651607790 None] Lock "cinder-604dce1c-3e1e-4458-b215-e2bc5f35929d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:24:10 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-73e13ff3-4dc1-40f3-b6a2-d723a6ace8c0 tempest-VolumesTransfersV355Test-1651607790 None] Acquiring lock "cinder-quobyte-604dce1c-3e1e-4458-b215-e2bc5f35929d" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:24:10 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-73e13ff3-4dc1-40f3-b6a2-d723a6ace8c0 tempest-VolumesTransfersV355Test-1651607790 None] Lock "cinder-quobyte-604dce1c-3e1e-4458-b215-e2bc5f35929d" acquired by "delete_volume" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:24:10 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c917e680-54e3-4a61-a504-18a8a885722f]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:24:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-73e13ff3-4dc1-40f3-b6a2-d723a6ace8c0 tempest-VolumesTransfersV355Test-1651607790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-604dce1c-3e1e-4458-b215-e2bc5f35929d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:10 devstack sudo[102202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-604dce1c-3e1e-4458-b215-e2bc5f35929d
Sep 16 16:24:10 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:11 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-73e13ff3-4dc1-40f3-b6a2-d723a6ace8c0 tempest-VolumesTransfersV355Test-1651607790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-604dce1c-3e1e-4458-b215-e2bc5f35929d" returned: 0 in 0.367s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-73e13ff3-4dc1-40f3-b6a2-d723a6ace8c0 tempest-VolumesTransfersV355Test-1651607790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-604dce1c-3e1e-4458-b215-e2bc5f35929d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:11 devstack sudo[102207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-604dce1c-3e1e-4458-b215-e2bc5f35929d
Sep 16 16:24:11 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:11 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-73e13ff3-4dc1-40f3-b6a2-d723a6ace8c0 tempest-VolumesTransfersV355Test-1651607790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-604dce1c-3e1e-4458-b215-e2bc5f35929d" returned: 0 in 0.255s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:11 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-73e13ff3-4dc1-40f3-b6a2-d723a6ace8c0 tempest-VolumesTransfersV355Test-1651607790 None] Lock "cinder-quobyte-604dce1c-3e1e-4458-b215-e2bc5f35929d" released by "delete_volume" :: held 0.665s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:24:11 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-73e13ff3-4dc1-40f3-b6a2-d723a6ace8c0 tempest-VolumesTransfersV355Test-1651607790 None] Created reservations ['ba695093-a1e6-41d3-a52c-ac810d5b6fae', '3322bea4-c27b-47ed-b399-02214b68f8ef', 'eba8617d-167d-4bee-b385-3b6d19c069db', '25993d67-540d-4f46-b7c7-eef7d0823ab2'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:24:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-73e13ff3-4dc1-40f3-b6a2-d723a6ace8c0 tempest-VolumesTransfersV355Test-1651607790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:24:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-73e13ff3-4dc1-40f3-b6a2-d723a6ace8c0 tempest-VolumesTransfersV355Test-1651607790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:24:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-73e13ff3-4dc1-40f3-b6a2-d723a6ace8c0 tempest-VolumesTransfersV355Test-1651607790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:24:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-73e13ff3-4dc1-40f3-b6a2-d723a6ace8c0 tempest-VolumesTransfersV355Test-1651607790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:24:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-73e13ff3-4dc1-40f3-b6a2-d723a6ace8c0 tempest-VolumesTransfersV355Test-1651607790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:24:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-73e13ff3-4dc1-40f3-b6a2-d723a6ace8c0 tempest-VolumesTransfersV355Test-1651607790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:11 devstack sudo[102210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:24:11 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:11 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-73e13ff3-4dc1-40f3-b6a2-d723a6ace8c0 tempest-VolumesTransfersV355Test-1651607790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.254s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:11 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-73e13ff3-4dc1-40f3-b6a2-d723a6ace8c0 tempest-VolumesTransfersV355Test-1651607790 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:24:11 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-73e13ff3-4dc1-40f3-b6a2-d723a6ace8c0 tempest-VolumesTransfersV355Test-1651607790 None] Deleted volume successfully.
Sep 16 16:24:11 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-73e13ff3-4dc1-40f3-b6a2-d723a6ace8c0 tempest-VolumesTransfersV355Test-1651607790 None] Lock "cinder-604dce1c-3e1e-4458-b215-e2bc5f35929d-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Flow 'volume_create_manager' (2d050f95-3651-4da7-aa2f-d3fd27495eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07168b8-e353-45fa-ab89-adc09db8f4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07168b8-e353-45fa-ab89-adc09db8f4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-708782860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=934d4c36-14ec-4443-ac01-bd85507dfa66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147318c49d8943aaa4c7789075517241',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:24:12Z,use_quota=True,user_id='eca43e031cda46dcb037b259132fb760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436feeca-d6e3-437d-8da2-1ea9e7b10e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436feeca-d6e3-437d-8da2-1ea9e7b10e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f016ce-227c-42bf-bfc8-3cf40238b6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f016ce-227c-42bf-bfc8-3cf40238b6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '934d4c36-14ec-4443-ac01-bd85507dfa66', 'volume_name': 'volume-934d4c36-14ec-4443-ac01-bd85507dfa66', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6845ea-7e4b-464d-9254-142c12a8e37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6845ea-7e4b-464d-9254-142c12a8e37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7defcacd-11cc-4064-8ad4-f7273ba8d52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:12 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Volume 934d4c36-14ec-4443-ac01-bd85507dfa66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-934d4c36-14ec-4443-ac01-bd85507dfa66', 'volume_size': 1}
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-708782860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=934d4c36-14ec-4443-ac01-bd85507dfa66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147318c49d8943aaa4c7789075517241',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:24:12Z,use_quota=True,user_id='eca43e031cda46dcb037b259132fb760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Creating volume 934d4c36-14ec-4443-ac01-bd85507dfa66 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:24:12 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-934d4c36-14ec-4443-ac01-bd85507dfa66 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:12 devstack sudo[102213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-934d4c36-14ec-4443-ac01-bd85507dfa66 1073741824
Sep 16 16:24:12 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:12 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-934d4c36-14ec-4443-ac01-bd85507dfa66 1073741824" returned: 0 in 0.429s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-934d4c36-14ec-4443-ac01-bd85507dfa66 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:13 devstack sudo[102224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-934d4c36-14ec-4443-ac01-bd85507dfa66
Sep 16 16:24:13 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:13 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-934d4c36-14ec-4443-ac01-bd85507dfa66" returned: 0 in 0.248s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:24:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:24:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7defcacd-11cc-4064-8ad4-f7273ba8d52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-934d4c36-14ec-4443-ac01-bd85507dfa66', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9273d6-a70c-4cfd-864e-804c7f1c9a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:13 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Volume volume-934d4c36-14ec-4443-ac01-bd85507dfa66 (934d4c36-14ec-4443-ac01-bd85507dfa66): created successfully
Sep 16 16:24:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9273d6-a70c-4cfd-864e-804c7f1c9a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Flow 'volume_create_manager' (2d050f95-3651-4da7-aa2f-d3fd27495eb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:24:13 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-9600b461-a567-4b4e-9acb-b1319fd58d25 tempest-VolumesTransfersV355Test-1732798607 None] Created volume successfully.
Sep 16 16:24:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-902dcbb7-fe66-4476-a798-135dd9b593f0 tempest-VolumesTransfersV355Test-1651607790 None] Acquiring lock "cinder-934d4c36-14ec-4443-ac01-bd85507dfa66-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:24:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-902dcbb7-fe66-4476-a798-135dd9b593f0 tempest-VolumesTransfersV355Test-1651607790 None] Lock "cinder-934d4c36-14ec-4443-ac01-bd85507dfa66-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:24:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-902dcbb7-fe66-4476-a798-135dd9b593f0 tempest-VolumesTransfersV355Test-1651607790 None] Acquiring lock "cinder-quobyte-934d4c36-14ec-4443-ac01-bd85507dfa66" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:24:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-902dcbb7-fe66-4476-a798-135dd9b593f0 tempest-VolumesTransfersV355Test-1651607790 None] Lock "cinder-quobyte-934d4c36-14ec-4443-ac01-bd85507dfa66" acquired by "delete_volume" :: waited 0.013s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:24:13 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dd970d-8eac-4d10-a0e2-2aed72f2be2e]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:24:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-902dcbb7-fe66-4476-a798-135dd9b593f0 tempest-VolumesTransfersV355Test-1651607790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-934d4c36-14ec-4443-ac01-bd85507dfa66 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:13 devstack sudo[102227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-934d4c36-14ec-4443-ac01-bd85507dfa66
Sep 16 16:24:13 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:14 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-902dcbb7-fe66-4476-a798-135dd9b593f0 tempest-VolumesTransfersV355Test-1651607790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-934d4c36-14ec-4443-ac01-bd85507dfa66" returned: 0 in 0.370s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-902dcbb7-fe66-4476-a798-135dd9b593f0 tempest-VolumesTransfersV355Test-1651607790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-934d4c36-14ec-4443-ac01-bd85507dfa66 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:14 devstack sudo[102233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-934d4c36-14ec-4443-ac01-bd85507dfa66
Sep 16 16:24:14 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:14 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-902dcbb7-fe66-4476-a798-135dd9b593f0 tempest-VolumesTransfersV355Test-1651607790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-934d4c36-14ec-4443-ac01-bd85507dfa66" returned: 0 in 0.241s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-902dcbb7-fe66-4476-a798-135dd9b593f0 tempest-VolumesTransfersV355Test-1651607790 None] Lock "cinder-quobyte-934d4c36-14ec-4443-ac01-bd85507dfa66" released by "delete_volume" :: held 0.652s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:24:14 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-902dcbb7-fe66-4476-a798-135dd9b593f0 tempest-VolumesTransfersV355Test-1651607790 None] Created reservations ['7fb8848c-98ad-4ef2-9c39-17e4c48ae5b9', '7e02abd4-5a37-47cb-8e2a-5de45f13b9de', 'f9f96ecb-c80b-4e25-85f1-ac8e5f8745d5', '52366c52-4401-40f2-8118-d8c7daad3c6d'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:24:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-902dcbb7-fe66-4476-a798-135dd9b593f0 tempest-VolumesTransfersV355Test-1651607790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:24:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-902dcbb7-fe66-4476-a798-135dd9b593f0 tempest-VolumesTransfersV355Test-1651607790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:24:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-902dcbb7-fe66-4476-a798-135dd9b593f0 tempest-VolumesTransfersV355Test-1651607790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:24:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-902dcbb7-fe66-4476-a798-135dd9b593f0 tempest-VolumesTransfersV355Test-1651607790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:24:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-902dcbb7-fe66-4476-a798-135dd9b593f0 tempest-VolumesTransfersV355Test-1651607790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:24:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-902dcbb7-fe66-4476-a798-135dd9b593f0 tempest-VolumesTransfersV355Test-1651607790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:14 devstack sudo[102236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:24:14 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:14 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-902dcbb7-fe66-4476-a798-135dd9b593f0 tempest-VolumesTransfersV355Test-1651607790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.256s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:14 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-902dcbb7-fe66-4476-a798-135dd9b593f0 tempest-VolumesTransfersV355Test-1651607790 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:24:14 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-902dcbb7-fe66-4476-a798-135dd9b593f0 tempest-VolumesTransfersV355Test-1651607790 None] Deleted volume successfully.
Sep 16 16:24:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-902dcbb7-fe66-4476-a798-135dd9b593f0 tempest-VolumesTransfersV355Test-1651607790 None] Lock "cinder-934d4c36-14ec-4443-ac01-bd85507dfa66-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Flow 'volume_create_manager' (7291b9ca-7937-459f-b2b5-5da9a2609f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (888fcbfc-f3e2-42ca-a865-114f0097b216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (888fcbfc-f3e2-42ca-a865-114f0097b216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-546829508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f268e9a-0600-4223-b036-c39ef7b99e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec96d243969844a49aee0b15aa7facd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:24:21Z,use_quota=True,user_id='d2d564a987ca48029a8d0fcdebdfeeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf90b56-d79b-4aea-8f41-0ccca281c6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf90b56-d79b-4aea-8f41-0ccca281c6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3000fa33-a9b0-44e1-a9b5-29e95df05101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3000fa33-a9b0-44e1-a9b5-29e95df05101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f268e9a-0600-4223-b036-c39ef7b99e38', 'volume_name': 'volume-1f268e9a-0600-4223-b036-c39ef7b99e38', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0f9eba-b816-411f-b21f-a0e5d366f2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0f9eba-b816-411f-b21f-a0e5d366f2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776ca529-106b-4964-8b00-48438e70144c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:21 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Volume 1f268e9a-0600-4223-b036-c39ef7b99e38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f268e9a-0600-4223-b036-c39ef7b99e38', 'volume_size': 1}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-546829508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f268e9a-0600-4223-b036-c39ef7b99e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec96d243969844a49aee0b15aa7facd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:24:21Z,use_quota=True,user_id='d2d564a987ca48029a8d0fcdebdfeeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Creating volume 1f268e9a-0600-4223-b036-c39ef7b99e38 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:24:21 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:21 devstack sudo[102240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38 1073741824
Sep 16 16:24:21 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:21 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38 1073741824" returned: 0 in 0.430s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:21 devstack sudo[102245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38
Sep 16 16:24:21 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:21 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38" returned: 0 in 0.292s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776ca529-106b-4964-8b00-48438e70144c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f268e9a-0600-4223-b036-c39ef7b99e38', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acceb71d-84b1-4040-a3bb-3dbe69269517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:21 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Volume volume-1f268e9a-0600-4223-b036-c39ef7b99e38 (1f268e9a-0600-4223-b036-c39ef7b99e38): created successfully
Sep 16 16:24:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acceb71d-84b1-4040-a3bb-3dbe69269517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Flow 'volume_create_manager' (7291b9ca-7937-459f-b2b5-5da9a2609f5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:24:22 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-f461757e-a4ff-40be-ac27-ddc9dcad6c71 tempest-VolumesCloneTest-911174105 None] Created volume successfully.
Sep 16 16:24:22 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:24:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Flow 'volume_create_manager' (408a42dc-54af-482e-a3c3-688f894a9335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:24:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9af716-e914-4c8d-a804-c427d11a6359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9af716-e914-4c8d-a804-c427d11a6359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1793656715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e8ad65-575b-41a2-ae97-af260b6c66f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec96d243969844a49aee0b15aa7facd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:24:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=1f268e9a-0600-4223-b036-c39ef7b99e38,status='creating',terminated_at=None,updated_at=2026-09-16T14:24:23Z,use_quota=True,user_id='d2d564a987ca48029a8d0fcdebdfeeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a68a177-e3a2-4f50-83b4-cb6d9dab5c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a68a177-e3a2-4f50-83b4-cb6d9dab5c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39ddde2-2f23-424c-820d-9152fa6c0ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:23 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39ddde2-2f23-424c-820d-9152fa6c0ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '82e8ad65-575b-41a2-ae97-af260b6c66f0', 'volume_name': 'volume-82e8ad65-575b-41a2-ae97-af260b6c66f0', 'volume_size': 2, 'source_volid': '1f268e9a-0600-4223-b036-c39ef7b99e38', 'source_volstatus': 'available'}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:23 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2583f298-8b3e-45a9-b2c7-56a33d4a3448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:23 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2583f298-8b3e-45a9-b2c7-56a33d4a3448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:23 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86b092f-7689-41cd-a226-294892ee8324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:23 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Volume 82e8ad65-575b-41a2-ae97-af260b6c66f0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-82e8ad65-575b-41a2-ae97-af260b6c66f0', 'volume_size': 2, 'source_volid': '1f268e9a-0600-4223-b036-c39ef7b99e38', 'source_volstatus': 'available'}
Sep 16 16:24:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:24:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:24:23 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Cloning volume 1f268e9a-0600-4223-b036-c39ef7b99e38 to volume 82e8ad65-575b-41a2-ae97-af260b6c66f0
Sep 16 16:24:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Creating offline snapshot 25a625e2-9ab7-4b1f-8f3f-ec719704188c of volume 1f268e9a-0600-4223-b036-c39ef7b99e38 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:24:23 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fa85e1-dd4b-48e8-aa06-93d5e8eb88a9]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:24:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:23 devstack sudo[102248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38
Sep 16 16:24:23 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:23 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38" returned: 0 in 0.387s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:23 devstack sudo[102253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c 1G
Sep 16 16:24:23 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:23 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c 1G" returned: 0 in 0.450s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f268e9a-0600-4223-b036-c39ef7b99e38 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:23 devstack sudo[102258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f268e9a-0600-4223-b036-c39ef7b99e38 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c
Sep 16 16:24:23 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:24 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f268e9a-0600-4223-b036-c39ef7b99e38 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c" returned: 0 in 0.339s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:24 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c is being set with open permissions: ugo+rw
Sep 16 16:24:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:24 devstack sudo[102263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c
Sep 16 16:24:24 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:24 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c" returned: 0 in 0.265s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:24 devstack sudo[102266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.info
Sep 16 16:24:24 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:24 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.info" returned: 0 in 0.271s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:24 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.info is being set with open permissions: ugo+rw
Sep 16 16:24:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:24 devstack sudo[102269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.info
Sep 16 16:24:24 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:25 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.info" returned: 0 in 0.264s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:25 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Acquiring lock "cinder-quobyte-82e8ad65-575b-41a2-ae97-af260b6c66f0" by "_copy_volume_from_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:24:25 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Lock "cinder-quobyte-82e8ad65-575b-41a2-ae97-af260b6c66f0" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:24:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] snapshot: 25a625e2-9ab7-4b1f-8f3f-ec719704188c, volume: 82e8ad65-575b-41a2-ae97-af260b6c66f0,  {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 16:24:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:24:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:24:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:24:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:24:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:24:25 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[be264cd6-e3e5-4cd2-a8d8-701b82973d4b]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:24:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:25 devstack sudo[102272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c
Sep 16 16:24:25 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:25 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c" returned: 0 in 0.388s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f268e9a-0600-4223-b036-c39ef7b99e38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:24:25 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13d88b5-56f7-4dc7-b571-a7a0e05e8093]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:24:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:25 devstack sudo[102277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38
Sep 16 16:24:25 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:26 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38" returned: 0 in 0.395s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:26 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] will copy from snapshot at /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38 {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 16:24:26 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Creating direct copy from snapshot {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 16:24:26 devstack cinder-volume[86165]: DEBUG cinder.utils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Path /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e8ad65-575b-41a2-ae97-af260b6c66f0 not found in is_blk_device check {{(pid=86165) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 16:24:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e8ad65-575b-41a2-ae97-af260b6c66f0 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:26 devstack sudo[102282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e8ad65-575b-41a2-ae97-af260b6c66f0
Sep 16 16:24:26 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:31 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e8ad65-575b-41a2-ae97-af260b6c66f0" returned: 0 in 5.502s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:31 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Image conversion details: src /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38, size 1024.00 MB, duration 5.50 sec, destination /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e8ad65-575b-41a2-ae97-af260b6c66f0 {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:24:31 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Converted 1024.00 MB image at 186.07 MB/s
Sep 16 16:24:31 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e8ad65-575b-41a2-ae97-af260b6c66f0 is being set with open permissions: ugo+rw
Sep 16 16:24:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e8ad65-575b-41a2-ae97-af260b6c66f0 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:31 devstack sudo[102296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e8ad65-575b-41a2-ae97-af260b6c66f0
Sep 16 16:24:31 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:31 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e8ad65-575b-41a2-ae97-af260b6c66f0" returned: 0 in 0.236s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Lock "cinder-quobyte-82e8ad65-575b-41a2-ae97-af260b6c66f0" released by "_copy_volume_from_snapshot" :: held 6.602s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:24:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Acquiring lock "cinder-quobyte-25a625e2-9ab7-4b1f-8f3f-ec719704188c" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:24:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Lock "cinder-quobyte-25a625e2-9ab7-4b1f-8f3f-ec719704188c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:24:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Deleting offline snapshot 25a625e2-9ab7-4b1f-8f3f-ec719704188c of volume 1f268e9a-0600-4223-b036-c39ef7b99e38 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:24:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] snapshot_file for this snap is: volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:24:31 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[278bdd02-e864-411d-a81c-5545d7895c2c]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:24:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:32 devstack sudo[102299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c
Sep 16 16:24:32 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:32 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c" returned: 0 in 0.377s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f268e9a-0600-4223-b036-c39ef7b99e38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:24:32 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e78ede-ad52-45da-9955-22a3dacbef79]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:24:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:32 devstack sudo[102304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38
Sep 16 16:24:32 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:32 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38" returned: 0 in 0.529s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:32 devstack sudo[102309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c
Sep 16 16:24:32 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:33 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c" returned: 0 in 0.315s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:33 devstack sudo[102314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c
Sep 16 16:24:33 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:33 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38.25a625e2-9ab7-4b1f-8f3f-ec719704188c" returned: 0 in 0.234s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Lock "cinder-quobyte-25a625e2-9ab7-4b1f-8f3f-ec719704188c" released by "_delete_snapshot" :: held 1.554s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:24:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.472s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:24:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86b092f-7689-41cd-a226-294892ee8324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82e8ad65-575b-41a2-ae97-af260b6c66f0', 'volume_size': 2, 'source_volid': '1f268e9a-0600-4223-b036-c39ef7b99e38', 'source_volstatus': 'available'}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7426d45b-b146-497f-ba43-8c62c30bf622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:33 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Volume volume-82e8ad65-575b-41a2-ae97-af260b6c66f0 (82e8ad65-575b-41a2-ae97-af260b6c66f0): created successfully
Sep 16 16:24:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7426d45b-b146-497f-ba43-8c62c30bf622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Flow 'volume_create_manager' (408a42dc-54af-482e-a3c3-688f894a9335) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:24:33 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-123eb01c-b7ab-4450-b426-f4bef2206d54 tempest-VolumesCloneTest-911174105 None] Created volume successfully.
Sep 16 16:24:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-065815c3-4d7c-46f3-aa7c-cf3c6d8e8c4a tempest-VolumesCloneTest-911174105 None] Acquiring lock "cinder-82e8ad65-575b-41a2-ae97-af260b6c66f0-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:24:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-065815c3-4d7c-46f3-aa7c-cf3c6d8e8c4a tempest-VolumesCloneTest-911174105 None] Lock "cinder-82e8ad65-575b-41a2-ae97-af260b6c66f0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:24:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-065815c3-4d7c-46f3-aa7c-cf3c6d8e8c4a tempest-VolumesCloneTest-911174105 None] Acquiring lock "cinder-quobyte-82e8ad65-575b-41a2-ae97-af260b6c66f0" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:24:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-065815c3-4d7c-46f3-aa7c-cf3c6d8e8c4a tempest-VolumesCloneTest-911174105 None] Lock "cinder-quobyte-82e8ad65-575b-41a2-ae97-af260b6c66f0" acquired by "delete_volume" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:24:33 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a27ef3c-eb3a-48ad-8db1-66b4601ac524]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:24:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-065815c3-4d7c-46f3-aa7c-cf3c6d8e8c4a tempest-VolumesCloneTest-911174105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e8ad65-575b-41a2-ae97-af260b6c66f0 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:34 devstack sudo[102317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e8ad65-575b-41a2-ae97-af260b6c66f0
Sep 16 16:24:34 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:34 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-065815c3-4d7c-46f3-aa7c-cf3c6d8e8c4a tempest-VolumesCloneTest-911174105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e8ad65-575b-41a2-ae97-af260b6c66f0" returned: 0 in 0.332s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-065815c3-4d7c-46f3-aa7c-cf3c6d8e8c4a tempest-VolumesCloneTest-911174105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e8ad65-575b-41a2-ae97-af260b6c66f0 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:34 devstack sudo[102322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e8ad65-575b-41a2-ae97-af260b6c66f0
Sep 16 16:24:34 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:34 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-065815c3-4d7c-46f3-aa7c-cf3c6d8e8c4a tempest-VolumesCloneTest-911174105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-82e8ad65-575b-41a2-ae97-af260b6c66f0" returned: 0 in 0.242s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-065815c3-4d7c-46f3-aa7c-cf3c6d8e8c4a tempest-VolumesCloneTest-911174105 None] Lock "cinder-quobyte-82e8ad65-575b-41a2-ae97-af260b6c66f0" released by "delete_volume" :: held 0.616s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:24:34 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-065815c3-4d7c-46f3-aa7c-cf3c6d8e8c4a tempest-VolumesCloneTest-911174105 None] Created reservations ['768e9ddf-1bfa-4d39-aa1f-6bd5388238fb', '9dfaed06-21f1-47ab-b17f-79cbcbe56762', '67d2e422-4c3d-477b-98bf-0008a67db2d0', '7b77336b-e460-4179-8e11-2f5e3b7356f5'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:24:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-065815c3-4d7c-46f3-aa7c-cf3c6d8e8c4a tempest-VolumesCloneTest-911174105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:24:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-065815c3-4d7c-46f3-aa7c-cf3c6d8e8c4a tempest-VolumesCloneTest-911174105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:24:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-065815c3-4d7c-46f3-aa7c-cf3c6d8e8c4a tempest-VolumesCloneTest-911174105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:24:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-065815c3-4d7c-46f3-aa7c-cf3c6d8e8c4a tempest-VolumesCloneTest-911174105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:24:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-065815c3-4d7c-46f3-aa7c-cf3c6d8e8c4a tempest-VolumesCloneTest-911174105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:24:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-065815c3-4d7c-46f3-aa7c-cf3c6d8e8c4a tempest-VolumesCloneTest-911174105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:34 devstack sudo[102325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:24:34 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:34 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-065815c3-4d7c-46f3-aa7c-cf3c6d8e8c4a tempest-VolumesCloneTest-911174105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.253s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:34 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-065815c3-4d7c-46f3-aa7c-cf3c6d8e8c4a tempest-VolumesCloneTest-911174105 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:24:34 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-065815c3-4d7c-46f3-aa7c-cf3c6d8e8c4a tempest-VolumesCloneTest-911174105 None] Deleted volume successfully.
Sep 16 16:24:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-065815c3-4d7c-46f3-aa7c-cf3c6d8e8c4a tempest-VolumesCloneTest-911174105 None] Lock "cinder-82e8ad65-575b-41a2-ae97-af260b6c66f0-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:24:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b88f5153-5608-49d3-86e6-a11ced2136e9 tempest-VolumesCloneTest-911174105 None] Acquiring lock "cinder-1f268e9a-0600-4223-b036-c39ef7b99e38-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:24:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b88f5153-5608-49d3-86e6-a11ced2136e9 tempest-VolumesCloneTest-911174105 None] Lock "cinder-1f268e9a-0600-4223-b036-c39ef7b99e38-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:24:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b88f5153-5608-49d3-86e6-a11ced2136e9 tempest-VolumesCloneTest-911174105 None] Acquiring lock "cinder-quobyte-1f268e9a-0600-4223-b036-c39ef7b99e38" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:24:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b88f5153-5608-49d3-86e6-a11ced2136e9 tempest-VolumesCloneTest-911174105 None] Lock "cinder-quobyte-1f268e9a-0600-4223-b036-c39ef7b99e38" acquired by "delete_volume" :: waited 0.015s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:24:35 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf0153d-c18a-45d3-bd35-cb1dd908255c]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:24:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b88f5153-5608-49d3-86e6-a11ced2136e9 tempest-VolumesCloneTest-911174105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:35 devstack sudo[102328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38
Sep 16 16:24:35 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:35 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b88f5153-5608-49d3-86e6-a11ced2136e9 tempest-VolumesCloneTest-911174105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38" returned: 0 in 0.383s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b88f5153-5608-49d3-86e6-a11ced2136e9 tempest-VolumesCloneTest-911174105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:35 devstack sudo[102333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38
Sep 16 16:24:35 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:35 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b88f5153-5608-49d3-86e6-a11ced2136e9 tempest-VolumesCloneTest-911174105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1f268e9a-0600-4223-b036-c39ef7b99e38" returned: 0 in 0.227s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b88f5153-5608-49d3-86e6-a11ced2136e9 tempest-VolumesCloneTest-911174105 None] Lock "cinder-quobyte-1f268e9a-0600-4223-b036-c39ef7b99e38" released by "delete_volume" :: held 0.680s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:24:35 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-b88f5153-5608-49d3-86e6-a11ced2136e9 tempest-VolumesCloneTest-911174105 None] Created reservations ['c0ec04ff-fee6-4683-9075-f23f43158683', 'fb40a10a-183e-46cb-ad05-d6424419c970', '064892d8-e905-4cdd-8fd9-a8706a62157d', 'de276237-c1e5-4ece-9b97-4ddfabf9c146'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:24:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b88f5153-5608-49d3-86e6-a11ced2136e9 tempest-VolumesCloneTest-911174105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:24:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b88f5153-5608-49d3-86e6-a11ced2136e9 tempest-VolumesCloneTest-911174105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:24:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b88f5153-5608-49d3-86e6-a11ced2136e9 tempest-VolumesCloneTest-911174105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:24:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b88f5153-5608-49d3-86e6-a11ced2136e9 tempest-VolumesCloneTest-911174105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:24:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b88f5153-5608-49d3-86e6-a11ced2136e9 tempest-VolumesCloneTest-911174105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:24:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b88f5153-5608-49d3-86e6-a11ced2136e9 tempest-VolumesCloneTest-911174105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:35 devstack sudo[102336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:24:35 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:36 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b88f5153-5608-49d3-86e6-a11ced2136e9 tempest-VolumesCloneTest-911174105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.251s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:36 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-b88f5153-5608-49d3-86e6-a11ced2136e9 tempest-VolumesCloneTest-911174105 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:24:36 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b88f5153-5608-49d3-86e6-a11ced2136e9 tempest-VolumesCloneTest-911174105 None] Deleted volume successfully.
Sep 16 16:24:36 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b88f5153-5608-49d3-86e6-a11ced2136e9 tempest-VolumesCloneTest-911174105 None] Lock "cinder-1f268e9a-0600-4223-b036-c39ef7b99e38-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:24:45 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=69,cinder:UPDATE=82,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:24:50 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=98,cinder:SELECT=51,cinder:INSERT=21,cinder:DELETE=9 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Flow 'volume_create_manager' (c55f1546-a756-462e-9a5d-e32f2467f77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90077ce-81b5-46bd-bd80-bb9f49cd5a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90077ce-81b5-46bd-bd80-bb9f49cd5a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1147592430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640e93be-9944-476e-88f3-8b8a3d251f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc1f0d5fd724c948714bf5a67c7c751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:24:53Z,use_quota=True,user_id='47e8bc84220549218e5a85770437cae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ce454c-e124-4402-b69c-d6dbac1ceb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ce454c-e124-4402-b69c-d6dbac1ceb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da26a4a3-c65d-4879-b0fb-25354050a561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da26a4a3-c65d-4879-b0fb-25354050a561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '640e93be-9944-476e-88f3-8b8a3d251f11', 'volume_name': 'volume-640e93be-9944-476e-88f3-8b8a3d251f11', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (869fdce0-d64d-4416-90a5-8aad01ce8f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (869fdce0-d64d-4416-90a5-8aad01ce8f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d22301-418d-4ad6-a566-7e6ea2cbc5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:53 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Volume 640e93be-9944-476e-88f3-8b8a3d251f11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-640e93be-9944-476e-88f3-8b8a3d251f11', 'volume_size': 1}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1147592430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640e93be-9944-476e-88f3-8b8a3d251f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc1f0d5fd724c948714bf5a67c7c751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:24:53Z,use_quota=True,user_id='47e8bc84220549218e5a85770437cae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Creating volume 640e93be-9944-476e-88f3-8b8a3d251f11 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:24:53 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:53 devstack sudo[102345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11 1073741824
Sep 16 16:24:53 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:53 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11 1073741824" returned: 0 in 0.477s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:53 devstack sudo[102352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11
Sep 16 16:24:53 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:53 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11" returned: 0 in 0.246s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d22301-418d-4ad6-a566-7e6ea2cbc5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-640e93be-9944-476e-88f3-8b8a3d251f11', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90fc885-56ec-49c0-b252-ab9b3f306e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:24:53 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Volume volume-640e93be-9944-476e-88f3-8b8a3d251f11 (640e93be-9944-476e-88f3-8b8a3d251f11): created successfully
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90fc885-56ec-49c0-b252-ab9b3f306e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:24:53 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Flow 'volume_create_manager' (c55f1546-a756-462e-9a5d-e32f2467f77c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:24:53 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-9b447caf-a1bf-4147-a1ee-08a959c177f3 tempest-VolumesSnapshotTestJSON-587457359 None] Created volume successfully.
Sep 16 16:24:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-29a97b33-dc77-40ab-8adf-b51c73daf0b0 tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:24:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-29a97b33-dc77-40ab-8adf-b51c73daf0b0 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:24:55 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-29a97b33-dc77-40ab-8adf-b51c73daf0b0 tempest-VolumesSnapshotTestJSON-587457359 None] Creating offline snapshot 489f4b4d-d6ca-424f-bad6-47128e9be529 of volume 640e93be-9944-476e-88f3-8b8a3d251f11 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:24:55 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[25aa8d18-fcd0-4253-88cd-ab3dfbcab7af]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:24:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29a97b33-dc77-40ab-8adf-b51c73daf0b0 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:55 devstack sudo[102356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11
Sep 16 16:24:55 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:55 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29a97b33-dc77-40ab-8adf-b51c73daf0b0 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11" returned: 0 in 0.370s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29a97b33-dc77-40ab-8adf-b51c73daf0b0 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.489f4b4d-d6ca-424f-bad6-47128e9be529 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:55 devstack sudo[102361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.489f4b4d-d6ca-424f-bad6-47128e9be529 1G
Sep 16 16:24:55 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:56 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29a97b33-dc77-40ab-8adf-b51c73daf0b0 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.489f4b4d-d6ca-424f-bad6-47128e9be529 1G" returned: 0 in 0.410s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29a97b33-dc77-40ab-8adf-b51c73daf0b0 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640e93be-9944-476e-88f3-8b8a3d251f11 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.489f4b4d-d6ca-424f-bad6-47128e9be529 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:56 devstack sudo[102367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640e93be-9944-476e-88f3-8b8a3d251f11 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.489f4b4d-d6ca-424f-bad6-47128e9be529
Sep 16 16:24:56 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:56 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29a97b33-dc77-40ab-8adf-b51c73daf0b0 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640e93be-9944-476e-88f3-8b8a3d251f11 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.489f4b4d-d6ca-424f-bad6-47128e9be529" returned: 0 in 0.304s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:56 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-29a97b33-dc77-40ab-8adf-b51c73daf0b0 tempest-VolumesSnapshotTestJSON-587457359 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.489f4b4d-d6ca-424f-bad6-47128e9be529 is being set with open permissions: ugo+rw
Sep 16 16:24:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29a97b33-dc77-40ab-8adf-b51c73daf0b0 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.489f4b4d-d6ca-424f-bad6-47128e9be529 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:56 devstack sudo[102372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.489f4b4d-d6ca-424f-bad6-47128e9be529
Sep 16 16:24:56 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:56 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29a97b33-dc77-40ab-8adf-b51c73daf0b0 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.489f4b4d-d6ca-424f-bad6-47128e9be529" returned: 0 in 0.244s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29a97b33-dc77-40ab-8adf-b51c73daf0b0 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:56 devstack sudo[102375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.info
Sep 16 16:24:56 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:57 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29a97b33-dc77-40ab-8adf-b51c73daf0b0 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.info" returned: 0 in 0.247s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:57 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-29a97b33-dc77-40ab-8adf-b51c73daf0b0 tempest-VolumesSnapshotTestJSON-587457359 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.info is being set with open permissions: ugo+rw
Sep 16 16:24:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29a97b33-dc77-40ab-8adf-b51c73daf0b0 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:57 devstack sudo[102378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.info
Sep 16 16:24:57 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:57 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29a97b33-dc77-40ab-8adf-b51c73daf0b0 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.info" returned: 0 in 0.231s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-29a97b33-dc77-40ab-8adf-b51c73daf0b0 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.896s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:24:57 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-29a97b33-dc77-40ab-8adf-b51c73daf0b0 tempest-VolumesSnapshotTestJSON-587457359 None] Create snapshot completed successfully
Sep 16 16:24:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1d4f7498-7568-4fbb-a9c5-e77937c7b2fd tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-489f4b4d-d6ca-424f-bad6-47128e9be529-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:24:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1d4f7498-7568-4fbb-a9c5-e77937c7b2fd tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-489f4b4d-d6ca-424f-bad6-47128e9be529-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:24:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1d4f7498-7568-4fbb-a9c5-e77937c7b2fd tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-quobyte-640e93be-9944-476e-88f3-8b8a3d251f11" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:24:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1d4f7498-7568-4fbb-a9c5-e77937c7b2fd tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-640e93be-9944-476e-88f3-8b8a3d251f11" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:24:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1d4f7498-7568-4fbb-a9c5-e77937c7b2fd tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-quobyte-489f4b4d-d6ca-424f-bad6-47128e9be529" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:24:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1d4f7498-7568-4fbb-a9c5-e77937c7b2fd tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-489f4b4d-d6ca-424f-bad6-47128e9be529" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:24:57 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-1d4f7498-7568-4fbb-a9c5-e77937c7b2fd tempest-VolumesSnapshotTestJSON-587457359 None] Deleting offline snapshot 489f4b4d-d6ca-424f-bad6-47128e9be529 of volume 640e93be-9944-476e-88f3-8b8a3d251f11 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:24:57 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-1d4f7498-7568-4fbb-a9c5-e77937c7b2fd tempest-VolumesSnapshotTestJSON-587457359 None] snapshot_file for this snap is: volume-640e93be-9944-476e-88f3-8b8a3d251f11.489f4b4d-d6ca-424f-bad6-47128e9be529 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:24:57 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9d0ca2-bf59-4267-baa5-46b937466f61]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:24:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d4f7498-7568-4fbb-a9c5-e77937c7b2fd tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.489f4b4d-d6ca-424f-bad6-47128e9be529 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:57 devstack sudo[102381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.489f4b4d-d6ca-424f-bad6-47128e9be529
Sep 16 16:24:57 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:58 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d4f7498-7568-4fbb-a9c5-e77937c7b2fd tempest-VolumesSnapshotTestJSON-587457359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.489f4b4d-d6ca-424f-bad6-47128e9be529" returned: 0 in 0.372s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:58 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-1d4f7498-7568-4fbb-a9c5-e77937c7b2fd tempest-VolumesSnapshotTestJSON-587457359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-640e93be-9944-476e-88f3-8b8a3d251f11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:24:58 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e083a9-ba0e-490d-9372-05372ea66fc6]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:24:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d4f7498-7568-4fbb-a9c5-e77937c7b2fd tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:58 devstack sudo[102386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11
Sep 16 16:24:58 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:58 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d4f7498-7568-4fbb-a9c5-e77937c7b2fd tempest-VolumesSnapshotTestJSON-587457359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11" returned: 0 in 0.367s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d4f7498-7568-4fbb-a9c5-e77937c7b2fd tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.489f4b4d-d6ca-424f-bad6-47128e9be529 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:58 devstack sudo[102391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.489f4b4d-d6ca-424f-bad6-47128e9be529
Sep 16 16:24:58 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:58 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d4f7498-7568-4fbb-a9c5-e77937c7b2fd tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.489f4b4d-d6ca-424f-bad6-47128e9be529" returned: 0 in 0.351s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d4f7498-7568-4fbb-a9c5-e77937c7b2fd tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.489f4b4d-d6ca-424f-bad6-47128e9be529 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:24:58 devstack sudo[102397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.489f4b4d-d6ca-424f-bad6-47128e9be529
Sep 16 16:24:58 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:24:59 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root
Sep 16 16:24:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d4f7498-7568-4fbb-a9c5-e77937c7b2fd tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11.489f4b4d-d6ca-424f-bad6-47128e9be529" returned: 0 in 0.246s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:24:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1d4f7498-7568-4fbb-a9c5-e77937c7b2fd tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-489f4b4d-d6ca-424f-bad6-47128e9be529" released by "_delete_snapshot" :: held 1.446s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:24:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1d4f7498-7568-4fbb-a9c5-e77937c7b2fd tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-640e93be-9944-476e-88f3-8b8a3d251f11" released by "delete_snapshot" :: held 1.469s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:24:59 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-1d4f7498-7568-4fbb-a9c5-e77937c7b2fd tempest-VolumesSnapshotTestJSON-587457359 None] Created reservations ['fac535b4-26db-4bc0-8a0c-be01b776b9d4', '09b83819-f117-47ee-9d7d-0aeb16f146c3', '4f1f3fe4-2939-4654-acb0-52739a8335dc', '0c562453-e7cf-4e65-b0c0-30a9f76d6734'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:24:59 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-1d4f7498-7568-4fbb-a9c5-e77937c7b2fd tempest-VolumesSnapshotTestJSON-587457359 None] Delete snapshot completed successfully.
Sep 16 16:24:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1d4f7498-7568-4fbb-a9c5-e77937c7b2fd tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-489f4b4d-d6ca-424f-bad6-47128e9be529-delete_snapshot" released by "delete_snapshot" :: held 1.658s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Flow 'volume_create_manager' (9066ada4-d36e-402c-b088-171a22435322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07f3d0b-f891-439c-83bd-c9f55fba016a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07f3d0b-f891-439c-83bd-c9f55fba016a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1572616249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3637a897-8fb4-4d86-8b36-9b3bf91ca439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc1f0d5fd724c948714bf5a67c7c751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:25:00Z,use_quota=True,user_id='47e8bc84220549218e5a85770437cae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029be023-326c-4de1-85b2-3c87f3d9778b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029be023-326c-4de1-85b2-3c87f3d9778b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e56c35f-cd2f-48f9-93f0-72dd1b2e235f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e56c35f-cd2f-48f9-93f0-72dd1b2e235f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3637a897-8fb4-4d86-8b36-9b3bf91ca439', 'volume_name': 'volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e30d617-c423-4fe8-a430-5bdf497499b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e30d617-c423-4fe8-a430-5bdf497499b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64294348-56c3-4e5e-9f0c-9acec986913d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:00 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Volume 3637a897-8fb4-4d86-8b36-9b3bf91ca439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439', 'volume_size': 1}
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:25:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1572616249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3637a897-8fb4-4d86-8b36-9b3bf91ca439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc1f0d5fd724c948714bf5a67c7c751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:25:00Z,use_quota=True,user_id='47e8bc84220549218e5a85770437cae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Creating volume 3637a897-8fb4-4d86-8b36-9b3bf91ca439 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:25:00 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:00 devstack sudo[102400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439 1073741824
Sep 16 16:25:00 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:00 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439 1073741824" returned: 0 in 0.443s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:00 devstack sudo[102406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439
Sep 16 16:25:00 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:01 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439" returned: 0 in 0.254s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:01 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:25:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:25:01 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64294348-56c3-4e5e-9f0c-9acec986913d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:01 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9f9517-780a-4e18-aac0-31ef1ce9a509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:01 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Volume volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439 (3637a897-8fb4-4d86-8b36-9b3bf91ca439): created successfully
Sep 16 16:25:01 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9f9517-780a-4e18-aac0-31ef1ce9a509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:01 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Flow 'volume_create_manager' (9066ada4-d36e-402c-b088-171a22435322) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:25:01 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-d832eebe-5660-4074-9f09-ada53461fa48 tempest-VolumesSnapshotTestJSON-587457359 None] Created volume successfully.
Sep 16 16:25:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-64c38a66-6784-4f0d-a0ac-0f9b0c3d68c5 tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:25:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-64c38a66-6784-4f0d-a0ac-0f9b0c3d68c5 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:25:01 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-64c38a66-6784-4f0d-a0ac-0f9b0c3d68c5 tempest-VolumesSnapshotTestJSON-587457359 None] Creating offline snapshot 4dac7dbc-67b1-40c4-87f1-5ede76f0a731 of volume 3637a897-8fb4-4d86-8b36-9b3bf91ca439 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:25:01 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb9fd4b-7a2e-4974-8fda-246b6b422cc3]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:25:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-64c38a66-6784-4f0d-a0ac-0f9b0c3d68c5 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:01 devstack sudo[102412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439
Sep 16 16:25:01 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:01 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-64c38a66-6784-4f0d-a0ac-0f9b0c3d68c5 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439" returned: 0 in 0.420s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-64c38a66-6784-4f0d-a0ac-0f9b0c3d68c5 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:01 devstack sudo[102417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731 1G
Sep 16 16:25:01 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:02 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-64c38a66-6784-4f0d-a0ac-0f9b0c3d68c5 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731 1G" returned: 0 in 0.482s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-64c38a66-6784-4f0d-a0ac-0f9b0c3d68c5 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:02 devstack sudo[102423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731
Sep 16 16:25:02 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:02 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-64c38a66-6784-4f0d-a0ac-0f9b0c3d68c5 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731" returned: 0 in 0.326s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:02 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-64c38a66-6784-4f0d-a0ac-0f9b0c3d68c5 tempest-VolumesSnapshotTestJSON-587457359 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731 is being set with open permissions: ugo+rw
Sep 16 16:25:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-64c38a66-6784-4f0d-a0ac-0f9b0c3d68c5 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:02 devstack sudo[102428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731
Sep 16 16:25:02 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:03 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-64c38a66-6784-4f0d-a0ac-0f9b0c3d68c5 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731" returned: 0 in 0.274s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-64c38a66-6784-4f0d-a0ac-0f9b0c3d68c5 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:03 devstack sudo[102431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.info
Sep 16 16:25:03 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:03 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-64c38a66-6784-4f0d-a0ac-0f9b0c3d68c5 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.info" returned: 0 in 0.350s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:03 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-64c38a66-6784-4f0d-a0ac-0f9b0c3d68c5 tempest-VolumesSnapshotTestJSON-587457359 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.info is being set with open permissions: ugo+rw
Sep 16 16:25:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-64c38a66-6784-4f0d-a0ac-0f9b0c3d68c5 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:03 devstack sudo[102618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.info
Sep 16 16:25:03 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:03 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-64c38a66-6784-4f0d-a0ac-0f9b0c3d68c5 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.info" returned: 0 in 0.297s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-64c38a66-6784-4f0d-a0ac-0f9b0c3d68c5 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.255s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:25:03 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-64c38a66-6784-4f0d-a0ac-0f9b0c3d68c5 tempest-VolumesSnapshotTestJSON-587457359 None] Create snapshot completed successfully
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Flow 'volume_create_manager' (3a4acfb2-571e-47e8-b14d-c0174bc5f56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc882cf5-1c46-498f-922f-443b4a1f25e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc882cf5-1c46-498f-922f-443b4a1f25e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1969929933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5cf0ba2-0388-40f8-a1bc-fc5e138400f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc1f0d5fd724c948714bf5a67c7c751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:25:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=4dac7dbc-67b1-40c4-87f1-5ede76f0a731,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:25:05Z,use_quota=True,user_id='47e8bc84220549218e5a85770437cae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62480cd7-2bf7-4b5e-bcb9-def19eec81ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62480cd7-2bf7-4b5e-bcb9-def19eec81ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1ad197-2106-4a96-adb5-2509d956802e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1ad197-2106-4a96-adb5-2509d956802e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f5cf0ba2-0388-40f8-a1bc-fc5e138400f3', 'volume_name': 'volume-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3', 'volume_size': 2, 'snapshot_id': '4dac7dbc-67b1-40c4-87f1-5ede76f0a731'}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77007c42-4e7c-4281-bf72-c64a3ecb871c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77007c42-4e7c-4281-bf72-c64a3ecb871c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de33edbb-f231-4f84-9d2f-b4198ba18bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:05 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Volume f5cf0ba2-0388-40f8-a1bc-fc5e138400f3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3', 'volume_size': 2, 'snapshot_id': '4dac7dbc-67b1-40c4-87f1-5ede76f0a731'}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-quobyte-4dac7dbc-67b1-40c4-87f1-5ede76f0a731-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3" by "_create_volume_from_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-4dac7dbc-67b1-40c4-87f1-5ede76f0a731-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Creating volume f5cf0ba2-0388-40f8-a1bc-fc5e138400f3 from snapshot 4dac7dbc-67b1-40c4-87f1-5ede76f0a731 {{(pid=86165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-quobyte-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3" by "_copy_volume_from_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] snapshot: 4dac7dbc-67b1-40c4-87f1-5ede76f0a731, volume: f5cf0ba2-0388-40f8-a1bc-fc5e138400f3,  {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4ff872-4d8b-403a-9d45-7f4eefbd0042]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:25:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:05 devstack sudo[102804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731
Sep 16 16:25:05 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:06 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731" returned: 0 in 0.440s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:06 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:25:06 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d4bec8-a751-489e-b995-14dc48868950]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:25:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:06 devstack sudo[102809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439
Sep 16 16:25:06 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:06 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439" returned: 0 in 0.426s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:06 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] will copy from snapshot at /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439 {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 16:25:06 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Creating direct copy from snapshot {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 16:25:06 devstack cinder-volume[86165]: DEBUG cinder.utils [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Path /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3 not found in is_blk_device check {{(pid=86165) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 16:25:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:06 devstack sudo[102814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3
Sep 16 16:25:06 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:25:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:25:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:25:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:25:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:25:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:25:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:07 devstack sudo[102826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:25:07 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:07 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.411s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:25:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:25:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 29 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:25:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>, <Thread(tpool_thread_0, started daemon 135438770624192)>, <Thread(tpool_thread_1, started daemon 135438762231488)>, <Thread(tpool_thread_2, started daemon 135438753838784)>, <Thread(tpool_thread_3, started daemon 135438745446080)>, <Thread(tpool_thread_4, started daemon 135438737053376)>, <Thread(tpool_thread_5, started daemon 135438728660672)>, <Thread(tpool_thread_6, started daemon 135438720267968)>, <Thread(tpool_thread_7, started daemon 135438711875264)>, <Thread(tpool_thread_8, started daemon 135438703466176)>, <Thread(tpool_thread_9, started daemon 135438695057088)>, <Thread(tpool_thread_10, started daemon 135438686648000)>, <Thread(tpool_thread_11, started daemon 135438678238912)>, <Thread(tpool_thread_12, started daemon 135438669829824)>, <Thread(tpool_thread_13, started daemon 135438661420736)>, <Thread(tpool_thread_14, started daemon 135438653011648)>, <Thread(tpool_thread_15, started daemon 135438644602560)>, <Thread(tpool_thread_16, started daemon 135438636193472)>, <Thread(tpool_thread_17, started daemon 135438627784384)>, <Thread(tpool_thread_18, started daemon 135438619375296)>, <Thread(tpool_thread_19, started daemon 135438610966208)>, <Thread(Rabbit-heartbeat, started daemon 135438772197760)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:25:12 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3" returned: 0 in 5.893s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:12 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Image conversion details: src /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3 {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:25:12 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Converted 1024.00 MB image at 173.74 MB/s
Sep 16 16:25:12 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3 is being set with open permissions: ugo+rw
Sep 16 16:25:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:12 devstack sudo[102917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3
Sep 16 16:25:12 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:12 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3" returned: 0 in 0.238s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3" released by "_copy_volume_from_snapshot" :: held 7.089s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:25:12 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-4dac7dbc-67b1-40c4-87f1-5ede76f0a731-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3" released by "_create_volume_from_snapshot" :: held 7.154s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:25:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.173s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:25:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de33edbb-f231-4f84-9d2f-b4198ba18bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3', 'volume_size': 2, 'snapshot_id': '4dac7dbc-67b1-40c4-87f1-5ede76f0a731'}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bab24a5-bfe5-4fe1-93ca-25a73de378de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:12 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Volume volume-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3 (f5cf0ba2-0388-40f8-a1bc-fc5e138400f3): created successfully
Sep 16 16:25:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bab24a5-bfe5-4fe1-93ca-25a73de378de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Flow 'volume_create_manager' (3a4acfb2-571e-47e8-b14d-c0174bc5f56e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:25:12 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-7f830d0e-4243-4fb9-a269-a90e38cae12c tempest-VolumesSnapshotTestJSON-587457359 None] Created volume successfully.
Sep 16 16:25:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5a1f2705-8403-4ea7-a2c1-c33c86a618b3 tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:25:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5a1f2705-8403-4ea7-a2c1-c33c86a618b3 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:25:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5a1f2705-8403-4ea7-a2c1-c33c86a618b3 tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-quobyte-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:25:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5a1f2705-8403-4ea7-a2c1-c33c86a618b3 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3" acquired by "delete_volume" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:25:13 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3668a3-ecbe-4f6c-8cb2-bc118871fb26]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:25:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5a1f2705-8403-4ea7-a2c1-c33c86a618b3 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:13 devstack sudo[102926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3
Sep 16 16:25:13 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:13 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5a1f2705-8403-4ea7-a2c1-c33c86a618b3 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3" returned: 0 in 0.397s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5a1f2705-8403-4ea7-a2c1-c33c86a618b3 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:13 devstack sudo[102931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3
Sep 16 16:25:13 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:13 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5a1f2705-8403-4ea7-a2c1-c33c86a618b3 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3" returned: 0 in 0.281s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5a1f2705-8403-4ea7-a2c1-c33c86a618b3 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3" released by "delete_volume" :: held 0.721s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:25:13 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-5a1f2705-8403-4ea7-a2c1-c33c86a618b3 tempest-VolumesSnapshotTestJSON-587457359 None] Created reservations ['d4bf12f9-6569-4080-87c8-3451a9ec826d', 'e3d4daa1-f483-4859-94d3-d563f170dc69', '6a6b4fe4-7458-47de-aaf5-dd3b5144f1fc', '16753f86-7d71-416d-97fa-091cd646765d'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:25:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5a1f2705-8403-4ea7-a2c1-c33c86a618b3 tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:25:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5a1f2705-8403-4ea7-a2c1-c33c86a618b3 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:25:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5a1f2705-8403-4ea7-a2c1-c33c86a618b3 tempest-VolumesSnapshotTestJSON-587457359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:25:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5a1f2705-8403-4ea7-a2c1-c33c86a618b3 tempest-VolumesSnapshotTestJSON-587457359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:25:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5a1f2705-8403-4ea7-a2c1-c33c86a618b3 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:25:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5a1f2705-8403-4ea7-a2c1-c33c86a618b3 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:13 devstack sudo[102934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:25:13 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:14 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5a1f2705-8403-4ea7-a2c1-c33c86a618b3 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.270s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:14 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-5a1f2705-8403-4ea7-a2c1-c33c86a618b3 tempest-VolumesSnapshotTestJSON-587457359 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:25:14 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-5a1f2705-8403-4ea7-a2c1-c33c86a618b3 tempest-VolumesSnapshotTestJSON-587457359 None] Deleted volume successfully.
Sep 16 16:25:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5a1f2705-8403-4ea7-a2c1-c33c86a618b3 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-f5cf0ba2-0388-40f8-a1bc-fc5e138400f3-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:25:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fe0012bc-3112-4f5b-96d9-c48c6de2f06f tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-4dac7dbc-67b1-40c4-87f1-5ede76f0a731-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:25:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fe0012bc-3112-4f5b-96d9-c48c6de2f06f tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-4dac7dbc-67b1-40c4-87f1-5ede76f0a731-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:25:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fe0012bc-3112-4f5b-96d9-c48c6de2f06f tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-quobyte-3637a897-8fb4-4d86-8b36-9b3bf91ca439" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:25:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fe0012bc-3112-4f5b-96d9-c48c6de2f06f tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-3637a897-8fb4-4d86-8b36-9b3bf91ca439" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:25:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fe0012bc-3112-4f5b-96d9-c48c6de2f06f tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-quobyte-4dac7dbc-67b1-40c4-87f1-5ede76f0a731" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:25:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fe0012bc-3112-4f5b-96d9-c48c6de2f06f tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-4dac7dbc-67b1-40c4-87f1-5ede76f0a731" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:25:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-fe0012bc-3112-4f5b-96d9-c48c6de2f06f tempest-VolumesSnapshotTestJSON-587457359 None] Deleting offline snapshot 4dac7dbc-67b1-40c4-87f1-5ede76f0a731 of volume 3637a897-8fb4-4d86-8b36-9b3bf91ca439 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:25:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-fe0012bc-3112-4f5b-96d9-c48c6de2f06f tempest-VolumesSnapshotTestJSON-587457359 None] snapshot_file for this snap is: volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:25:14 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99449d1-8a7c-4fb1-9a9e-5b45f44f383b]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:25:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fe0012bc-3112-4f5b-96d9-c48c6de2f06f tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:14 devstack sudo[102937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731
Sep 16 16:25:14 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:14 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fe0012bc-3112-4f5b-96d9-c48c6de2f06f tempest-VolumesSnapshotTestJSON-587457359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731" returned: 0 in 0.369s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-fe0012bc-3112-4f5b-96d9-c48c6de2f06f tempest-VolumesSnapshotTestJSON-587457359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:25:14 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a77dfd8-c587-4b24-aa63-65cf5739ce6a]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:25:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fe0012bc-3112-4f5b-96d9-c48c6de2f06f tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:14 devstack sudo[102942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439
Sep 16 16:25:14 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:15 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fe0012bc-3112-4f5b-96d9-c48c6de2f06f tempest-VolumesSnapshotTestJSON-587457359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439" returned: 0 in 0.515s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fe0012bc-3112-4f5b-96d9-c48c6de2f06f tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:15 devstack sudo[102947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731
Sep 16 16:25:15 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:15 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fe0012bc-3112-4f5b-96d9-c48c6de2f06f tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731" returned: 0 in 0.321s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fe0012bc-3112-4f5b-96d9-c48c6de2f06f tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:15 devstack sudo[102952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731
Sep 16 16:25:15 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:15 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-fe0012bc-3112-4f5b-96d9-c48c6de2f06f tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439.4dac7dbc-67b1-40c4-87f1-5ede76f0a731" returned: 0 in 0.250s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fe0012bc-3112-4f5b-96d9-c48c6de2f06f tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-4dac7dbc-67b1-40c4-87f1-5ede76f0a731" released by "_delete_snapshot" :: held 1.566s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:25:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fe0012bc-3112-4f5b-96d9-c48c6de2f06f tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-3637a897-8fb4-4d86-8b36-9b3bf91ca439" released by "delete_snapshot" :: held 1.594s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:25:15 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-fe0012bc-3112-4f5b-96d9-c48c6de2f06f tempest-VolumesSnapshotTestJSON-587457359 None] Created reservations ['7fd4fdc3-8359-46fb-a041-88c3e0c1d113', '34abaf82-518b-4402-9eec-55b439113251', '18c019cc-d050-462f-98fe-eebcee2cb929', '12955839-a2fd-4843-bd99-53d5dce48699'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:25:16 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-fe0012bc-3112-4f5b-96d9-c48c6de2f06f tempest-VolumesSnapshotTestJSON-587457359 None] Delete snapshot completed successfully.
Sep 16 16:25:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-fe0012bc-3112-4f5b-96d9-c48c6de2f06f tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-4dac7dbc-67b1-40c4-87f1-5ede76f0a731-delete_snapshot" released by "delete_snapshot" :: held 1.737s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:25:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e11d618a-c898-4df0-8671-b08d90c8d0d6 tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-3637a897-8fb4-4d86-8b36-9b3bf91ca439-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:25:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e11d618a-c898-4df0-8671-b08d90c8d0d6 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-3637a897-8fb4-4d86-8b36-9b3bf91ca439-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:25:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e11d618a-c898-4df0-8671-b08d90c8d0d6 tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-quobyte-3637a897-8fb4-4d86-8b36-9b3bf91ca439" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:25:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e11d618a-c898-4df0-8671-b08d90c8d0d6 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-3637a897-8fb4-4d86-8b36-9b3bf91ca439" acquired by "delete_volume" :: waited 0.014s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:25:16 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bdb376-d8a6-4411-973e-2e89feeacd6c]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:25:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e11d618a-c898-4df0-8671-b08d90c8d0d6 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:16 devstack sudo[102955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439
Sep 16 16:25:16 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:17 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e11d618a-c898-4df0-8671-b08d90c8d0d6 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439" returned: 0 in 0.355s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e11d618a-c898-4df0-8671-b08d90c8d0d6 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:17 devstack sudo[102960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439
Sep 16 16:25:17 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:17 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e11d618a-c898-4df0-8671-b08d90c8d0d6 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3637a897-8fb4-4d86-8b36-9b3bf91ca439" returned: 0 in 0.258s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e11d618a-c898-4df0-8671-b08d90c8d0d6 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-3637a897-8fb4-4d86-8b36-9b3bf91ca439" released by "delete_volume" :: held 0.683s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:25:17 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-e11d618a-c898-4df0-8671-b08d90c8d0d6 tempest-VolumesSnapshotTestJSON-587457359 None] Created reservations ['55c4f62b-27ef-4ec0-a0be-7558fc45c92b', '568c77aa-c718-45e0-9c4b-601669192b97', '33978170-689b-4434-84f1-35a1dd787b5a', '4e782f2e-8585-447f-859b-ad3e45891117'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:25:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e11d618a-c898-4df0-8671-b08d90c8d0d6 tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:25:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e11d618a-c898-4df0-8671-b08d90c8d0d6 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:25:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e11d618a-c898-4df0-8671-b08d90c8d0d6 tempest-VolumesSnapshotTestJSON-587457359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:25:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e11d618a-c898-4df0-8671-b08d90c8d0d6 tempest-VolumesSnapshotTestJSON-587457359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:25:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e11d618a-c898-4df0-8671-b08d90c8d0d6 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:25:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e11d618a-c898-4df0-8671-b08d90c8d0d6 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:17 devstack sudo[102963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:25:17 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:17 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e11d618a-c898-4df0-8671-b08d90c8d0d6 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.282s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:17 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-e11d618a-c898-4df0-8671-b08d90c8d0d6 tempest-VolumesSnapshotTestJSON-587457359 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:25:17 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-e11d618a-c898-4df0-8671-b08d90c8d0d6 tempest-VolumesSnapshotTestJSON-587457359 None] Deleted volume successfully.
Sep 16 16:25:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e11d618a-c898-4df0-8671-b08d90c8d0d6 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-3637a897-8fb4-4d86-8b36-9b3bf91ca439-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:25:18 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:25:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Flow 'volume_create_manager' (75d1b9b0-511f-43a0-bec5-76b6f6dd4576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:25:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e03a0032-e0dc-46a1-9dcf-c3e167d5464c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e03a0032-e0dc-46a1-9dcf-c3e167d5464c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-120311132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77553bd7-28e8-46c0-a8f4-ccd0f979e0f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc1f0d5fd724c948714bf5a67c7c751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:25:18Z,use_quota=True,user_id='47e8bc84220549218e5a85770437cae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130068f9-c955-4637-a028-59384a6891d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130068f9-c955-4637-a028-59384a6891d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c11914b-e5d8-42a6-aa1f-d8622bf99594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c11914b-e5d8-42a6-aa1f-d8622bf99594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77553bd7-28e8-46c0-a8f4-ccd0f979e0f3', 'volume_name': 'volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82d1926-9cbb-4c1f-a034-c05c820d6e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82d1926-9cbb-4c1f-a034-c05c820d6e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (359f4358-4c41-4f8d-b0b2-7130003cec4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:18 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Volume 77553bd7-28e8-46c0-a8f4-ccd0f979e0f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3', 'volume_size': 1}
Sep 16 16:25:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:25:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:25:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-120311132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77553bd7-28e8-46c0-a8f4-ccd0f979e0f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc1f0d5fd724c948714bf5a67c7c751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:25:18Z,use_quota=True,user_id='47e8bc84220549218e5a85770437cae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:25:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Creating volume 77553bd7-28e8-46c0-a8f4-ccd0f979e0f3 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:25:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:25:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:25:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:25:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:25:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:25:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:25:18 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:25:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:18 devstack sudo[102966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3 1073741824
Sep 16 16:25:18 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:19 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3 1073741824" returned: 0 in 0.485s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:19 devstack sudo[102971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3
Sep 16 16:25:19 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:19 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3" returned: 0 in 0.270s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:25:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:25:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (359f4358-4c41-4f8d-b0b2-7130003cec4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f37069-c115-4ac7-bf98-30566c22e397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:19 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Volume volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3 (77553bd7-28e8-46c0-a8f4-ccd0f979e0f3): created successfully
Sep 16 16:25:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f37069-c115-4ac7-bf98-30566c22e397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Flow 'volume_create_manager' (75d1b9b0-511f-43a0-bec5-76b6f6dd4576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:25:19 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-e1eef02e-d363-4a61-84d9-5c142d72863c tempest-VolumesSnapshotTestJSON-587457359 None] Created volume successfully.
Sep 16 16:25:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-59c974d6-fe39-4680-ab7d-2e030efd341a tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:25:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-59c974d6-fe39-4680-ab7d-2e030efd341a tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:25:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-59c974d6-fe39-4680-ab7d-2e030efd341a tempest-VolumesSnapshotTestJSON-587457359 None] Creating offline snapshot c92fef8c-0c27-4e46-85d9-1fe11317057f of volume 77553bd7-28e8-46c0-a8f4-ccd0f979e0f3 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:25:20 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[668b4e7b-c563-49e6-aef1-90960bc89bba]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:25:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-59c974d6-fe39-4680-ab7d-2e030efd341a tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:20 devstack sudo[102974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3
Sep 16 16:25:20 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:21 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-59c974d6-fe39-4680-ab7d-2e030efd341a tempest-VolumesSnapshotTestJSON-587457359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3" returned: 0 in 0.389s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-59c974d6-fe39-4680-ab7d-2e030efd341a tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:21 devstack sudo[102980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f 1G
Sep 16 16:25:21 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:21 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-59c974d6-fe39-4680-ab7d-2e030efd341a tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f 1G" returned: 0 in 0.414s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-59c974d6-fe39-4680-ab7d-2e030efd341a tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:21 devstack sudo[102986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f
Sep 16 16:25:21 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:21 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-59c974d6-fe39-4680-ab7d-2e030efd341a tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f" returned: 0 in 0.318s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:21 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-59c974d6-fe39-4680-ab7d-2e030efd341a tempest-VolumesSnapshotTestJSON-587457359 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f is being set with open permissions: ugo+rw
Sep 16 16:25:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-59c974d6-fe39-4680-ab7d-2e030efd341a tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:21 devstack sudo[102992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f
Sep 16 16:25:21 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:22 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-59c974d6-fe39-4680-ab7d-2e030efd341a tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f" returned: 0 in 0.248s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-59c974d6-fe39-4680-ab7d-2e030efd341a tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:22 devstack sudo[102995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.info
Sep 16 16:25:22 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:22 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-59c974d6-fe39-4680-ab7d-2e030efd341a tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.info" returned: 0 in 0.265s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:22 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-59c974d6-fe39-4680-ab7d-2e030efd341a tempest-VolumesSnapshotTestJSON-587457359 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.info is being set with open permissions: ugo+rw
Sep 16 16:25:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-59c974d6-fe39-4680-ab7d-2e030efd341a tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:22 devstack sudo[102998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.info
Sep 16 16:25:22 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:22 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-59c974d6-fe39-4680-ab7d-2e030efd341a tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.info" returned: 0 in 0.265s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-59c974d6-fe39-4680-ab7d-2e030efd341a tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.004s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:25:22 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-59c974d6-fe39-4680-ab7d-2e030efd341a tempest-VolumesSnapshotTestJSON-587457359 None] Create snapshot completed successfully
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Flow 'volume_create_manager' (1135d298-17b8-4c7c-a03b-95cc8e706f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d12276-fc94-4538-8d1d-2611b9a93909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d12276-fc94-4538-8d1d-2611b9a93909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1355253644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c651d74-2491-4a72-9f52-dd5487069988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc1f0d5fd724c948714bf5a67c7c751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c92fef8c-0c27-4e46-85d9-1fe11317057f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:25:23Z,use_quota=True,user_id='47e8bc84220549218e5a85770437cae9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2dcf29-fc43-4ef3-a6b6-f0d12163d92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2dcf29-fc43-4ef3-a6b6-f0d12163d92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5edf23c5-3dca-42fd-be11-618439ac5a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5edf23c5-3dca-42fd-be11-618439ac5a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9c651d74-2491-4a72-9f52-dd5487069988', 'volume_name': 'volume-9c651d74-2491-4a72-9f52-dd5487069988', 'volume_size': 1, 'snapshot_id': 'c92fef8c-0c27-4e46-85d9-1fe11317057f'}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb1d37a-71a1-474a-8f3c-63e32761a4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb1d37a-71a1-474a-8f3c-63e32761a4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e2cfc4-9321-41d5-9958-c1cd3e9252ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:23 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Volume 9c651d74-2491-4a72-9f52-dd5487069988: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9c651d74-2491-4a72-9f52-dd5487069988', 'volume_size': 1, 'snapshot_id': 'c92fef8c-0c27-4e46-85d9-1fe11317057f'}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-quobyte-c92fef8c-0c27-4e46-85d9-1fe11317057f-9c651d74-2491-4a72-9f52-dd5487069988" by "_create_volume_from_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-c92fef8c-0c27-4e46-85d9-1fe11317057f-9c651d74-2491-4a72-9f52-dd5487069988" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Creating volume 9c651d74-2491-4a72-9f52-dd5487069988 from snapshot c92fef8c-0c27-4e46-85d9-1fe11317057f {{(pid=86165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-quobyte-9c651d74-2491-4a72-9f52-dd5487069988" by "_copy_volume_from_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-9c651d74-2491-4a72-9f52-dd5487069988" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] snapshot: c92fef8c-0c27-4e46-85d9-1fe11317057f, volume: 9c651d74-2491-4a72-9f52-dd5487069988,  {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f948b26-74d2-4bde-84ef-c32ce3d98803]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:23 devstack sudo[103001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f
Sep 16 16:25:23 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:23 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f" returned: 0 in 0.385s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40233fe-0c4d-4861-a2b2-8bc1f2e56cf3]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:25:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:24 devstack sudo[103006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3
Sep 16 16:25:24 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:24 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3" returned: 0 in 0.393s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:24 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] will copy from snapshot at /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3 {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 16:25:24 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Creating direct copy from snapshot {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 16:25:24 devstack cinder-volume[86165]: DEBUG cinder.utils [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Path /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9c651d74-2491-4a72-9f52-dd5487069988 not found in is_blk_device check {{(pid=86165) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 16:25:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9c651d74-2491-4a72-9f52-dd5487069988 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:24 devstack sudo[103011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9c651d74-2491-4a72-9f52-dd5487069988
Sep 16 16:25:24 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:30 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9c651d74-2491-4a72-9f52-dd5487069988" returned: 0 in 5.728s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:30 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Image conversion details: src /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9c651d74-2491-4a72-9f52-dd5487069988 {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:25:30 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Converted 1024.00 MB image at 178.73 MB/s
Sep 16 16:25:30 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9c651d74-2491-4a72-9f52-dd5487069988 is being set with open permissions: ugo+rw
Sep 16 16:25:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9c651d74-2491-4a72-9f52-dd5487069988 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:30 devstack sudo[103024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9c651d74-2491-4a72-9f52-dd5487069988
Sep 16 16:25:30 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:30 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9c651d74-2491-4a72-9f52-dd5487069988" returned: 0 in 0.246s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-9c651d74-2491-4a72-9f52-dd5487069988" released by "_copy_volume_from_snapshot" :: held 6.840s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:25:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-c92fef8c-0c27-4e46-85d9-1fe11317057f-9c651d74-2491-4a72-9f52-dd5487069988" released by "_create_volume_from_snapshot" :: held 6.903s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:25:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.918s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:25:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e2cfc4-9321-41d5-9958-c1cd3e9252ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c651d74-2491-4a72-9f52-dd5487069988', 'volume_size': 1, 'snapshot_id': 'c92fef8c-0c27-4e46-85d9-1fe11317057f'}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b56d55d-2679-43db-86de-767b4cb20174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:25:30 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Volume volume-9c651d74-2491-4a72-9f52-dd5487069988 (9c651d74-2491-4a72-9f52-dd5487069988): created successfully
Sep 16 16:25:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b56d55d-2679-43db-86de-767b4cb20174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:25:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Flow 'volume_create_manager' (1135d298-17b8-4c7c-a03b-95cc8e706f7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:25:30 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-28d161b2-9cd5-4900-87a8-7e411b6ad50d tempest-VolumesSnapshotTestJSON-587457359 None] Created volume successfully.
Sep 16 16:25:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d41c6603-20ea-48d8-8ebe-ca2c716a92f8 tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-9c651d74-2491-4a72-9f52-dd5487069988-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:25:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d41c6603-20ea-48d8-8ebe-ca2c716a92f8 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-9c651d74-2491-4a72-9f52-dd5487069988-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:25:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d41c6603-20ea-48d8-8ebe-ca2c716a92f8 tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-quobyte-9c651d74-2491-4a72-9f52-dd5487069988" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:25:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d41c6603-20ea-48d8-8ebe-ca2c716a92f8 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-9c651d74-2491-4a72-9f52-dd5487069988" acquired by "delete_volume" :: waited 0.013s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:25:31 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7551b9c5-f6a7-46e3-a85c-3ddfcc35785d]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:25:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d41c6603-20ea-48d8-8ebe-ca2c716a92f8 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9c651d74-2491-4a72-9f52-dd5487069988 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:31 devstack sudo[103028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9c651d74-2491-4a72-9f52-dd5487069988
Sep 16 16:25:31 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:31 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d41c6603-20ea-48d8-8ebe-ca2c716a92f8 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9c651d74-2491-4a72-9f52-dd5487069988" returned: 0 in 0.360s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d41c6603-20ea-48d8-8ebe-ca2c716a92f8 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9c651d74-2491-4a72-9f52-dd5487069988 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:31 devstack sudo[103033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9c651d74-2491-4a72-9f52-dd5487069988
Sep 16 16:25:31 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:31 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d41c6603-20ea-48d8-8ebe-ca2c716a92f8 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9c651d74-2491-4a72-9f52-dd5487069988" returned: 0 in 0.262s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d41c6603-20ea-48d8-8ebe-ca2c716a92f8 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-9c651d74-2491-4a72-9f52-dd5487069988" released by "delete_volume" :: held 0.662s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:25:31 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-d41c6603-20ea-48d8-8ebe-ca2c716a92f8 tempest-VolumesSnapshotTestJSON-587457359 None] Created reservations ['351c8756-322a-4a6c-837a-6bdebd821923', '65639b85-b9cb-4dc7-aba1-ccd55b17db68', '10f61229-78ac-4948-9d32-875bf7d4d48a', '467a4aaa-e9e9-4ef1-b4cc-5868ca27c5d8'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:25:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d41c6603-20ea-48d8-8ebe-ca2c716a92f8 tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:25:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d41c6603-20ea-48d8-8ebe-ca2c716a92f8 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:25:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d41c6603-20ea-48d8-8ebe-ca2c716a92f8 tempest-VolumesSnapshotTestJSON-587457359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:25:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d41c6603-20ea-48d8-8ebe-ca2c716a92f8 tempest-VolumesSnapshotTestJSON-587457359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:25:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d41c6603-20ea-48d8-8ebe-ca2c716a92f8 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:25:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d41c6603-20ea-48d8-8ebe-ca2c716a92f8 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:31 devstack sudo[103036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:25:31 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:32 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d41c6603-20ea-48d8-8ebe-ca2c716a92f8 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.243s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:32 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-d41c6603-20ea-48d8-8ebe-ca2c716a92f8 tempest-VolumesSnapshotTestJSON-587457359 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:25:32 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-d41c6603-20ea-48d8-8ebe-ca2c716a92f8 tempest-VolumesSnapshotTestJSON-587457359 None] Deleted volume successfully.
Sep 16 16:25:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d41c6603-20ea-48d8-8ebe-ca2c716a92f8 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-9c651d74-2491-4a72-9f52-dd5487069988-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:25:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4d13c799-d887-4d07-ac62-38d67386ab48 tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-c92fef8c-0c27-4e46-85d9-1fe11317057f-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:25:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4d13c799-d887-4d07-ac62-38d67386ab48 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-c92fef8c-0c27-4e46-85d9-1fe11317057f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:25:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4d13c799-d887-4d07-ac62-38d67386ab48 tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-quobyte-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:25:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4d13c799-d887-4d07-ac62-38d67386ab48 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:25:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4d13c799-d887-4d07-ac62-38d67386ab48 tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-quobyte-c92fef8c-0c27-4e46-85d9-1fe11317057f" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:25:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4d13c799-d887-4d07-ac62-38d67386ab48 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-c92fef8c-0c27-4e46-85d9-1fe11317057f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:25:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-4d13c799-d887-4d07-ac62-38d67386ab48 tempest-VolumesSnapshotTestJSON-587457359 None] Deleting offline snapshot c92fef8c-0c27-4e46-85d9-1fe11317057f of volume 77553bd7-28e8-46c0-a8f4-ccd0f979e0f3 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:25:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-4d13c799-d887-4d07-ac62-38d67386ab48 tempest-VolumesSnapshotTestJSON-587457359 None] snapshot_file for this snap is: volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:25:32 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60922f0-fd5d-4d90-a634-ca380a1b2d22]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:25:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4d13c799-d887-4d07-ac62-38d67386ab48 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:32 devstack sudo[103039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f
Sep 16 16:25:32 devstack sudo[103039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:32 devstack sudo[103039]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4d13c799-d887-4d07-ac62-38d67386ab48 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f" returned: 0 in 0.371s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-4d13c799-d887-4d07-ac62-38d67386ab48 tempest-VolumesSnapshotTestJSON-587457359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:25:32 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bfd113-007d-4dff-86dd-2a03cce48ab6]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:25:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4d13c799-d887-4d07-ac62-38d67386ab48 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:32 devstack sudo[103044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3
Sep 16 16:25:32 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:33 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4d13c799-d887-4d07-ac62-38d67386ab48 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3" returned: 0 in 0.530s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4d13c799-d887-4d07-ac62-38d67386ab48 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:33 devstack sudo[103049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f
Sep 16 16:25:33 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:33 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4d13c799-d887-4d07-ac62-38d67386ab48 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f" returned: 0 in 0.340s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4d13c799-d887-4d07-ac62-38d67386ab48 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:33 devstack sudo[103055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f
Sep 16 16:25:33 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:33 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4d13c799-d887-4d07-ac62-38d67386ab48 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3.c92fef8c-0c27-4e46-85d9-1fe11317057f" returned: 0 in 0.265s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4d13c799-d887-4d07-ac62-38d67386ab48 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-c92fef8c-0c27-4e46-85d9-1fe11317057f" released by "_delete_snapshot" :: held 1.625s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:25:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4d13c799-d887-4d07-ac62-38d67386ab48 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3" released by "delete_snapshot" :: held 1.649s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:25:33 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-4d13c799-d887-4d07-ac62-38d67386ab48 tempest-VolumesSnapshotTestJSON-587457359 None] Created reservations ['7b2c32dd-c6bf-46d8-a973-7dcc631728d6', '1fd6911b-2927-4fb6-ab66-b6f6a02021e1', '47b84c5c-c3be-42be-8ad1-69731130e8b6', 'd01bc7b7-bbb0-4446-bf1b-ae55997b4046'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:25:34 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-4d13c799-d887-4d07-ac62-38d67386ab48 tempest-VolumesSnapshotTestJSON-587457359 None] Delete snapshot completed successfully.
Sep 16 16:25:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4d13c799-d887-4d07-ac62-38d67386ab48 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-c92fef8c-0c27-4e46-85d9-1fe11317057f-delete_snapshot" released by "delete_snapshot" :: held 1.795s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:25:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-8ddc2a24-da4d-44c6-9789-36ac672bfdba tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:25:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-8ddc2a24-da4d-44c6-9789-36ac672bfdba tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:25:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-8ddc2a24-da4d-44c6-9789-36ac672bfdba tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-quobyte-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:25:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-8ddc2a24-da4d-44c6-9789-36ac672bfdba tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3" acquired by "delete_volume" :: waited 0.018s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:25:34 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3bf187-0cb4-4f5e-992a-46d3b4a0baef]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:25:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8ddc2a24-da4d-44c6-9789-36ac672bfdba tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:34 devstack sudo[103058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3
Sep 16 16:25:34 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:35 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8ddc2a24-da4d-44c6-9789-36ac672bfdba tempest-VolumesSnapshotTestJSON-587457359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3" returned: 0 in 0.404s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8ddc2a24-da4d-44c6-9789-36ac672bfdba tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:35 devstack sudo[103063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3
Sep 16 16:25:35 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:35 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8ddc2a24-da4d-44c6-9789-36ac672bfdba tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3" returned: 0 in 0.267s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-8ddc2a24-da4d-44c6-9789-36ac672bfdba tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3" released by "delete_volume" :: held 0.740s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:25:35 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-8ddc2a24-da4d-44c6-9789-36ac672bfdba tempest-VolumesSnapshotTestJSON-587457359 None] Created reservations ['244a04fa-0ae1-4461-92a8-7d375b4dd8df', '55af5266-336c-440a-9ba2-fdc3ac58feb7', 'e417b047-7731-484b-9c07-6651aee973fc', '7205e114-f054-465f-a852-bab6f0080f46'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:25:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8ddc2a24-da4d-44c6-9789-36ac672bfdba tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:25:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8ddc2a24-da4d-44c6-9789-36ac672bfdba tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:25:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8ddc2a24-da4d-44c6-9789-36ac672bfdba tempest-VolumesSnapshotTestJSON-587457359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:25:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8ddc2a24-da4d-44c6-9789-36ac672bfdba tempest-VolumesSnapshotTestJSON-587457359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:25:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8ddc2a24-da4d-44c6-9789-36ac672bfdba tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:25:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8ddc2a24-da4d-44c6-9789-36ac672bfdba tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:35 devstack sudo[103066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:25:35 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:35 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8ddc2a24-da4d-44c6-9789-36ac672bfdba tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.276s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:35 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-8ddc2a24-da4d-44c6-9789-36ac672bfdba tempest-VolumesSnapshotTestJSON-587457359 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:25:35 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-8ddc2a24-da4d-44c6-9789-36ac672bfdba tempest-VolumesSnapshotTestJSON-587457359 None] Deleted volume successfully.
Sep 16 16:25:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-46c78d6d-9326-46af-b143-ed00fcebe5b1 tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-640e93be-9944-476e-88f3-8b8a3d251f11-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:25:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-46c78d6d-9326-46af-b143-ed00fcebe5b1 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-640e93be-9944-476e-88f3-8b8a3d251f11-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:25:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-8ddc2a24-da4d-44c6-9789-36ac672bfdba tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-77553bd7-28e8-46c0-a8f4-ccd0f979e0f3-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:25:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-46c78d6d-9326-46af-b143-ed00fcebe5b1 tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "cinder-quobyte-640e93be-9944-476e-88f3-8b8a3d251f11" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:25:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-46c78d6d-9326-46af-b143-ed00fcebe5b1 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-640e93be-9944-476e-88f3-8b8a3d251f11" acquired by "delete_volume" :: waited 0.015s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:25:35 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[24774069-df2a-4551-9877-573e48d3b992]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:25:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-46c78d6d-9326-46af-b143-ed00fcebe5b1 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:35 devstack sudo[103069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11
Sep 16 16:25:35 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:36 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-46c78d6d-9326-46af-b143-ed00fcebe5b1 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11" returned: 0 in 0.352s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-46c78d6d-9326-46af-b143-ed00fcebe5b1 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:36 devstack sudo[103074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11
Sep 16 16:25:36 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:36 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-46c78d6d-9326-46af-b143-ed00fcebe5b1 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-640e93be-9944-476e-88f3-8b8a3d251f11" returned: 0 in 0.258s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:36 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-46c78d6d-9326-46af-b143-ed00fcebe5b1 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-quobyte-640e93be-9944-476e-88f3-8b8a3d251f11" released by "delete_volume" :: held 0.680s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:25:36 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-46c78d6d-9326-46af-b143-ed00fcebe5b1 tempest-VolumesSnapshotTestJSON-587457359 None] Created reservations ['a415184a-412a-47f5-870e-e2fff4ca4c43', 'b2f5e537-9d77-4645-876b-16a9e6bdbba1', '73eb0451-fa9e-4909-8a82-e7be22a08c52', '227b86af-4314-42eb-8b7d-2d8d76c2cfaa'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:25:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-46c78d6d-9326-46af-b143-ed00fcebe5b1 tempest-VolumesSnapshotTestJSON-587457359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:25:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-46c78d6d-9326-46af-b143-ed00fcebe5b1 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:25:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-46c78d6d-9326-46af-b143-ed00fcebe5b1 tempest-VolumesSnapshotTestJSON-587457359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:25:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-46c78d6d-9326-46af-b143-ed00fcebe5b1 tempest-VolumesSnapshotTestJSON-587457359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:25:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-46c78d6d-9326-46af-b143-ed00fcebe5b1 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:25:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-46c78d6d-9326-46af-b143-ed00fcebe5b1 tempest-VolumesSnapshotTestJSON-587457359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:25:36 devstack sudo[103077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:25:36 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:25:36 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root
Sep 16 16:25:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-46c78d6d-9326-46af-b143-ed00fcebe5b1 tempest-VolumesSnapshotTestJSON-587457359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.270s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:25:36 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-46c78d6d-9326-46af-b143-ed00fcebe5b1 tempest-VolumesSnapshotTestJSON-587457359 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:25:36 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-46c78d6d-9326-46af-b143-ed00fcebe5b1 tempest-VolumesSnapshotTestJSON-587457359 None] Deleted volume successfully.
Sep 16 16:25:36 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-46c78d6d-9326-46af-b143-ed00fcebe5b1 tempest-VolumesSnapshotTestJSON-587457359 None] Lock "cinder-640e93be-9944-476e-88f3-8b8a3d251f11-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:25:46 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=68,cinder:UPDATE=75,cinder:INSERT=18,cinder:DELETE=8 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:25:46 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=78,cinder:SELECT=74,cinder:INSERT=22,cinder:DELETE=5 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:26:07 devstack sudo[103127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:26:07 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:26:07 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.241s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 29 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>, <Thread(tpool_thread_0, started daemon 135438770624192)>, <Thread(tpool_thread_1, started daemon 135438762231488)>, <Thread(tpool_thread_2, started daemon 135438753838784)>, <Thread(tpool_thread_3, started daemon 135438745446080)>, <Thread(tpool_thread_4, started daemon 135438737053376)>, <Thread(tpool_thread_5, started daemon 135438728660672)>, <Thread(tpool_thread_6, started daemon 135438720267968)>, <Thread(tpool_thread_7, started daemon 135438711875264)>, <Thread(tpool_thread_8, started daemon 135438703466176)>, <Thread(tpool_thread_9, started daemon 135438695057088)>, <Thread(tpool_thread_10, started daemon 135438686648000)>, <Thread(tpool_thread_11, started daemon 135438678238912)>, <Thread(tpool_thread_12, started daemon 135438669829824)>, <Thread(tpool_thread_13, started daemon 135438661420736)>, <Thread(tpool_thread_14, started daemon 135438653011648)>, <Thread(tpool_thread_15, started daemon 135438644602560)>, <Thread(tpool_thread_16, started daemon 135438636193472)>, <Thread(tpool_thread_17, started daemon 135438627784384)>, <Thread(tpool_thread_18, started daemon 135438619375296)>, <Thread(tpool_thread_19, started daemon 135438610966208)>, <Thread(Rabbit-heartbeat, started daemon 135438772197760)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Flow 'volume_create_manager' (118644fa-7e76-42f6-8473-b1e0ae2f0277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba99528-9de3-49c4-8a83-00145cbf53cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba99528-9de3-49c4-8a83-00145cbf53cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1281587273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9219e9ba-5fb4-46f4-aa21-bfd5c53d3030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a8814e91f5439fabde1bdbe62cd10b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:08Z,use_quota=True,user_id='0d0133f8f72d458592e6ef12a0232313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e727581a-9324-42a6-911b-d98fec02b52a),volume_type_id=e727581a-9324-42a6-911b-d98fec02b52a)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c671e6e6-1734-47d5-ad64-4012387fa44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c671e6e6-1734-47d5-ad64-4012387fa44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4682bc7f-9d3b-42c3-99af-e54dc51685b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4682bc7f-9d3b-42c3-99af-e54dc51685b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9219e9ba-5fb4-46f4-aa21-bfd5c53d3030', 'volume_name': 'volume-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e60b051-6643-4d4d-85f2-4d0b8db292d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e60b051-6643-4d4d-85f2-4d0b8db292d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b80737f-4e23-4623-9018-b1733801d123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:26:07 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Volume 9219e9ba-5fb4-46f4-aa21-bfd5c53d3030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030', 'volume_size': 1}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1281587273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9219e9ba-5fb4-46f4-aa21-bfd5c53d3030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a8814e91f5439fabde1bdbe62cd10b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:08Z,use_quota=True,user_id='0d0133f8f72d458592e6ef12a0232313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e727581a-9324-42a6-911b-d98fec02b52a),volume_type_id=e727581a-9324-42a6-911b-d98fec02b52a)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Creating volume 9219e9ba-5fb4-46f4-aa21-bfd5c53d3030 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:26:07 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:26:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:26:08 devstack sudo[103131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030 1073741824
Sep 16 16:26:08 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Flow 'volume_create_manager' (3e42a900-7d10-4cad-9b7f-16e4cad82458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224870b1-1397-40a9-b86e-440048f3ed1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224870b1-1397-40a9-b86e-440048f3ed1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-15086039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddae6525-1560-48ab-a8ca-74d802269121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a8814e91f5439fabde1bdbe62cd10b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:08Z,use_quota=True,user_id='0d0133f8f72d458592e6ef12a0232313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98a69659-99da-403b-8bde-f80e36f065de),volume_type_id=98a69659-99da-403b-8bde-f80e36f065de)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0e3e07-ca0f-4d28-abe2-e8c2f4d34af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0e3e07-ca0f-4d28-abe2-e8c2f4d34af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b0c6d9-1a9a-4d0b-8864-f6a374259061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b0c6d9-1a9a-4d0b-8864-f6a374259061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddae6525-1560-48ab-a8ca-74d802269121', 'volume_name': 'volume-ddae6525-1560-48ab-a8ca-74d802269121', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36451232-3b6a-4c1c-a34a-4ba809110de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36451232-3b6a-4c1c-a34a-4ba809110de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b9dc08-b2be-4612-950a-1c4868e940ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:26:08 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Volume ddae6525-1560-48ab-a8ca-74d802269121: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddae6525-1560-48ab-a8ca-74d802269121', 'volume_size': 1}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:26:08 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030 1073741824" returned: 0 in 0.544s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:26:08 devstack sudo[103137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030
Sep 16 16:26:08 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:26:08 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030" returned: 0 in 0.270s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.412s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-15086039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddae6525-1560-48ab-a8ca-74d802269121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a8814e91f5439fabde1bdbe62cd10b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:08Z,use_quota=True,user_id='0d0133f8f72d458592e6ef12a0232313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98a69659-99da-403b-8bde-f80e36f065de),volume_type_id=98a69659-99da-403b-8bde-f80e36f065de)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Creating volume ddae6525-1560-48ab-a8ca-74d802269121 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:26:08 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ddae6525-1560-48ab-a8ca-74d802269121 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b80737f-4e23-4623-9018-b1733801d123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:26:08 devstack sudo[103140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ddae6525-1560-48ab-a8ca-74d802269121 1073741824
Sep 16 16:26:08 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd09069-d8b4-4921-b119-30559a9bcbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:26:08 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Volume volume-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030 (9219e9ba-5fb4-46f4-aa21-bfd5c53d3030): created successfully
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd09069-d8b4-4921-b119-30559a9bcbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:26:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Flow 'volume_create_manager' (118644fa-7e76-42f6-8473-b1e0ae2f0277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:26:08 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-147b9e72-925d-41bf-ba16-2f936e13e932 tempest-TestInstancesWithCinderVolumes-1975034506 None] Created volume successfully.
Sep 16 16:26:09 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:26:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Flow 'volume_create_manager' (d118ee75-d433-4b10-9148-430b74b3b0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:26:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91c0e90-af20-430f-ba53-30bb60c44f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:26:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91c0e90-af20-430f-ba53-30bb60c44f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-980406569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b566276-6675-481a-96d4-275d94a25b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a8814e91f5439fabde1bdbe62cd10b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:09Z,use_quota=True,user_id='0d0133f8f72d458592e6ef12a0232313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2509af0b-d944-459b-bbfc-78ce8ab199a3),volume_type_id=2509af0b-d944-459b-bbfc-78ce8ab199a3)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:26:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e93b9b-42ea-4c76-a907-01751e9759e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:26:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e93b9b-42ea-4c76-a907-01751e9759e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:26:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0980c17c-ab95-4347-be0a-42c1b915a3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:26:09 devstack cinder-volume[86165]: DEBUG cinder.image.glance [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Creating Keystone auth plugin from conf {{(pid=86165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 16:26:09 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root
Sep 16 16:26:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ddae6525-1560-48ab-a8ca-74d802269121 1073741824" returned: 0 in 0.521s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:26:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ddae6525-1560-48ab-a8ca-74d802269121 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:26:09 devstack sudo[103146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ddae6525-1560-48ab-a8ca-74d802269121
Sep 16 16:26:09 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:26:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0980c17c-ab95-4347-be0a-42c1b915a3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2b566276-6675-481a-96d4-275d94a25b47', 'volume_name': 'volume-2b566276-6675-481a-96d4-275d94a25b47', 'volume_size': 1, 'image_id': 'a1acffc0-78af-4280-9cd1-be247f289c8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1acffc0-78af-4280-9cd1-be247f289c8d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--230062246', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39a8814e91f5439fabde1bdbe62cd10b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1acffc0-78af-4280-9cd1-be247f289c8d', 'created_at': datetime.datetime(2026, 9, 16, 14, 26, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 26, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1acffc0-78af-4280-9cd1-be247f289c8d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e41af5ca0>}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:26:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68d4485-8db9-4bf4-b16b-1135c609e1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:26:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68d4485-8db9-4bf4-b16b-1135c609e1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:26:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a037b7e9-678b-4963-af18-16d914a6db1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:26:09 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Volume 2b566276-6675-481a-96d4-275d94a25b47: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2b566276-6675-481a-96d4-275d94a25b47', 'volume_size': 1, 'image_id': 'a1acffc0-78af-4280-9cd1-be247f289c8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1acffc0-78af-4280-9cd1-be247f289c8d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--230062246', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39a8814e91f5439fabde1bdbe62cd10b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1acffc0-78af-4280-9cd1-be247f289c8d', 'created_at': datetime.datetime(2026, 9, 16, 14, 26, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 26, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1acffc0-78af-4280-9cd1-be247f289c8d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e41af5ca0>}
Sep 16 16:26:09 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Trying to clone 2b566276-6675-481a-96d4-275d94a25b47 from image a1acffc0-78af-4280-9cd1-be247f289c8d at location (None, [{'url': 'file:///opt/stack/data/glance/images/a1acffc0-78af-4280-9cd1-be247f289c8d', 'metadata': {}}]). {{(pid=86165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 16:26:09 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root
Sep 16 16:26:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ddae6525-1560-48ab-a8ca-74d802269121" returned: 0 in 0.281s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:26:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:26:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:26:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b9dc08-b2be-4612-950a-1c4868e940ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddae6525-1560-48ab-a8ca-74d802269121', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:26:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2795e99c-c543-40c4-8399-76f80ade674d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:26:09 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Volume volume-ddae6525-1560-48ab-a8ca-74d802269121 (ddae6525-1560-48ab-a8ca-74d802269121): created successfully
Sep 16 16:26:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2795e99c-c543-40c4-8399-76f80ade674d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:26:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Flow 'volume_create_manager' (3e42a900-7d10-4cad-9b7f-16e4cad82458) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:26:09 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-af56d9f2-372e-4d37-9bdf-7da104deef37 tempest-TestInstancesWithCinderVolumes-1975034506 None] Created volume successfully.
Sep 16 16:26:12 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a1acffc0-78af-4280-9cd1-be247f289c8d_jwssxi54devstack@QuobyteHD, size 20.69 MB, duration 2.81 sec {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 16:26:12 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Image download 20.69 MB at 7.36 MB/s
Sep 16 16:26:12 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9704dc7-fe4f-4188-825c-f7bb8e350fc4]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:26:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1acffc0-78af-4280-9cd1-be247f289c8d_jwssxi54devstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:26:12 devstack sudo[103150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1acffc0-78af-4280-9cd1-be247f289c8d_jwssxi54devstack@QuobyteHD
Sep 16 16:26:12 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:26:12 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root
Sep 16 16:26:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1acffc0-78af-4280-9cd1-be247f289c8d_jwssxi54devstack@QuobyteHD" returned: 0 in 0.356s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:26:12 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Temporary image a1acffc0-78af-4280-9cd1-be247f289c8d is fetched for user 0d0133f8f72d458592e6ef12a0232313. {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 16:26:12 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb59318d-de04-4fbf-b096-04925686b2cf]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:26:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1acffc0-78af-4280-9cd1-be247f289c8d_jwssxi54devstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:26:12 devstack sudo[103161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1acffc0-78af-4280-9cd1-be247f289c8d_jwssxi54devstack@QuobyteHD
Sep 16 16:26:12 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:26:13 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root
Sep 16 16:26:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1acffc0-78af-4280-9cd1-be247f289c8d_jwssxi54devstack@QuobyteHD" returned: 0 in 0.320s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:26:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:26:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:26:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-980406569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b566276-6675-481a-96d4-275d94a25b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a8814e91f5439fabde1bdbe62cd10b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:09Z,use_quota=True,user_id='0d0133f8f72d458592e6ef12a0232313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2509af0b-d944-459b-bbfc-78ce8ab199a3),volume_type_id=2509af0b-d944-459b-bbfc-78ce8ab199a3)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:26:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Creating volume 2b566276-6675-481a-96d4-275d94a25b47 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:26:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:26:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:26:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:26:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:26:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:26:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:26:13 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:26:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2b566276-6675-481a-96d4-275d94a25b47 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:26:13 devstack sudo[103166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2b566276-6675-481a-96d4-275d94a25b47 1073741824
Sep 16 16:26:13 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:26:13 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root
Sep 16 16:26:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2b566276-6675-481a-96d4-275d94a25b47 1073741824" returned: 0 in 0.428s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:26:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2b566276-6675-481a-96d4-275d94a25b47 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:26:13 devstack sudo[103172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2b566276-6675-481a-96d4-275d94a25b47
Sep 16 16:26:13 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:26:13 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root
Sep 16 16:26:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2b566276-6675-481a-96d4-275d94a25b47" returned: 0 in 0.262s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:26:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:26:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:26:13 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Attempting download of a1acffc0-78af-4280-9cd1-be247f289c8d ((None, [{'url': 'file:///opt/stack/data/glance/images/a1acffc0-78af-4280-9cd1-be247f289c8d', 'metadata': {}}])) to volume 2b566276-6675-481a-96d4-275d94a25b47. {{(pid=86165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 16:26:14 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f11a4e3-f2ac-46f7-b020-36ef567500cb]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:26:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1acffc0-78af-4280-9cd1-be247f289c8d_oft1y8rm {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:26:14 devstack sudo[103175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1acffc0-78af-4280-9cd1-be247f289c8d_oft1y8rm
Sep 16 16:26:14 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:26:14 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root
Sep 16 16:26:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1acffc0-78af-4280-9cd1-be247f289c8d_oft1y8rm" returned: 0 in 0.344s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:26:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1acffc0-78af-4280-9cd1-be247f289c8d_oft1y8rm {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:26:14 devstack sudo[103179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1acffc0-78af-4280-9cd1-be247f289c8d_oft1y8rm
Sep 16 16:26:14 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:26:14 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root
Sep 16 16:26:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1acffc0-78af-4280-9cd1-be247f289c8d_oft1y8rm" returned: 1 in 0.316s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:26:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1acffc0-78af-4280-9cd1-be247f289c8d_oft1y8rm' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:26:14 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c774e81-f2b4-4739-9c72-65432d125697]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:26:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1acffc0-78af-4280-9cd1-be247f289c8d_jwssxi54devstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:26:14 devstack sudo[103183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1acffc0-78af-4280-9cd1-be247f289c8d_jwssxi54devstack@QuobyteHD
Sep 16 16:26:14 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:26:15 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root
Sep 16 16:26:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a1acffc0-78af-4280-9cd1-be247f289c8d_jwssxi54devstack@QuobyteHD" returned: 0 in 0.347s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:26:15 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] a1acffc0-78af-4280-9cd1-be247f289c8d was qcow2, converting to qcow2 {{(pid=86165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 16:26:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1acffc0-78af-4280-9cd1-be247f289c8d_jwssxi54devstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2b566276-6675-481a-96d4-275d94a25b47 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:26:15 devstack sudo[103188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1acffc0-78af-4280-9cd1-be247f289c8d_jwssxi54devstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2b566276-6675-481a-96d4-275d94a25b47
Sep 16 16:26:15 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:26:16 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root
Sep 16 16:26:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a1acffc0-78af-4280-9cd1-be247f289c8d_jwssxi54devstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2b566276-6675-481a-96d4-275d94a25b47" returned: 0 in 1.857s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:26:16 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a1acffc0-78af-4280-9cd1-be247f289c8d_jwssxi54devstack@QuobyteHD, size 112.00 MB, duration 1.86 sec, destination /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2b566276-6675-481a-96d4-275d94a25b47 {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:26:16 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Converted 112.00 MB image at 60.26 MB/s
Sep 16 16:26:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2b566276-6675-481a-96d4-275d94a25b47 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:26:16 devstack sudo[103195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2b566276-6675-481a-96d4-275d94a25b47 1G
Sep 16 16:26:16 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:26:17 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root
Sep 16 16:26:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2b566276-6675-481a-96d4-275d94a25b47 1G" returned: 0 in 0.344s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:26:17 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Downloaded image a1acffc0-78af-4280-9cd1-be247f289c8d ((None, [{'url': 'file:///opt/stack/data/glance/images/a1acffc0-78af-4280-9cd1-be247f289c8d', 'metadata': {}}])) to volume 2b566276-6675-481a-96d4-275d94a25b47 successfully. {{(pid=86165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 16:26:17 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Temporary image a1acffc0-78af-4280-9cd1-be247f289c8d for user 0d0133f8f72d458592e6ef12a0232313 is deleted. {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 16:26:17 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Marking volume 2b566276-6675-481a-96d4-275d94a25b47 as bootable. {{(pid=86165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 16:26:17 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Copying metadata from image a1acffc0-78af-4280-9cd1-be247f289c8d to 2b566276-6675-481a-96d4-275d94a25b47. {{(pid=86165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 16:26:17 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Creating volume glance metadata for volume 2b566276-6675-481a-96d4-275d94a25b47 backed by image a1acffc0-78af-4280-9cd1-be247f289c8d with: {'image_id': 'a1acffc0-78af-4280-9cd1-be247f289c8d', 'image_name': 'tempest-scenario-img--230062246', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 16:26:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a037b7e9-678b-4963-af18-16d914a6db1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b566276-6675-481a-96d4-275d94a25b47', 'volume_size': 1, 'image_id': 'a1acffc0-78af-4280-9cd1-be247f289c8d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1acffc0-78af-4280-9cd1-be247f289c8d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--230062246', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39a8814e91f5439fabde1bdbe62cd10b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a1acffc0-78af-4280-9cd1-be247f289c8d', 'created_at': datetime.datetime(2026, 9, 16, 14, 26, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 26, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1acffc0-78af-4280-9cd1-be247f289c8d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e41af5ca0>}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:26:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f2e63a-51a6-40af-8f12-1b6119ae6a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:26:17 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Volume volume-2b566276-6675-481a-96d4-275d94a25b47 (2b566276-6675-481a-96d4-275d94a25b47): created successfully
Sep 16 16:26:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f2e63a-51a6-40af-8f12-1b6119ae6a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:26:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Flow 'volume_create_manager' (d118ee75-d433-4b10-9148-430b74b3b0f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:26:17 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-53f70064-29a9-48f0-8bed-6cf330a0d116 tempest-TestInstancesWithCinderVolumes-1975034506 None] Created volume successfully.
Sep 16 16:26:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-5c5b1478-7067-43c2-af6d-80c740062fd3 req-e5ebf6ce-e0e4-4f91-839e-1526af829be5 tempest-TestInstancesWithCinderVolumes-1975034506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:26:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-5c5b1478-7067-43c2-af6d-80c740062fd3 req-e5ebf6ce-e0e4-4f91-839e-1526af829be5 tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:26:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-5c5b1478-7067-43c2-af6d-80c740062fd3 req-e5ebf6ce-e0e4-4f91-839e-1526af829be5 tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:26:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-5c5b1478-7067-43c2-af6d-80c740062fd3 req-e5ebf6ce-e0e4-4f91-839e-1526af829be5 tempest-TestInstancesWithCinderVolumes-1975034506 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-2b566276-6675-481a-96d4-275d94a25b47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c5fdc79-18b6-450b-8698-85879cf07746', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:26:20 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-5c5b1478-7067-43c2-af6d-80c740062fd3 req-e5ebf6ce-e0e4-4f91-839e-1526af829be5 tempest-TestInstancesWithCinderVolumes-1975034506 None] attachment_update completed successfully.
Sep 16 16:26:30 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=11,cinder:SELECT=14,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:26:30 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=22,cinder:UPDATE=13,cinder:INSERT=3 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:26:50 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=1 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:26:50 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=1 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:26:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-073a07e4-a057-4727-8229-fc753c246528 req-23767cdd-63f9-48ae-b846-11af9383bb06 tempest-TestInstancesWithCinderVolumes-1975034506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:26:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-073a07e4-a057-4727-8229-fc753c246528 req-23767cdd-63f9-48ae-b846-11af9383bb06 tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:26:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-073a07e4-a057-4727-8229-fc753c246528 req-23767cdd-63f9-48ae-b846-11af9383bb06 tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:26:52 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-073a07e4-a057-4727-8229-fc753c246528 req-23767cdd-63f9-48ae-b846-11af9383bb06 tempest-TestInstancesWithCinderVolumes-1975034506 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5707d5f-a689-437a-a379-df5e6b9614c7', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:26:52 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-073a07e4-a057-4727-8229-fc753c246528 req-23767cdd-63f9-48ae-b846-11af9383bb06 tempest-TestInstancesWithCinderVolumes-1975034506 None] attachment_update completed successfully.
Sep 16 16:26:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-81ef679a-0340-44ee-bc12-827f3c47f2a7 req-6935136a-eebc-496b-b36b-96fdd56aedfc tempest-TestInstancesWithCinderVolumes-1975034506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:26:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-81ef679a-0340-44ee-bc12-827f3c47f2a7 req-6935136a-eebc-496b-b36b-96fdd56aedfc tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:26:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-81ef679a-0340-44ee-bc12-827f3c47f2a7 req-6935136a-eebc-496b-b36b-96fdd56aedfc tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:26:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-81ef679a-0340-44ee-bc12-827f3c47f2a7 req-6935136a-eebc-496b-b36b-96fdd56aedfc tempest-TestInstancesWithCinderVolumes-1975034506 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-ddae6525-1560-48ab-a8ca-74d802269121', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab1a5ba6-fc66-45a3-8c95-9d8f8f10db2c', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:26:54 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-81ef679a-0340-44ee-bc12-827f3c47f2a7 req-6935136a-eebc-496b-b36b-96fdd56aedfc tempest-TestInstancesWithCinderVolumes-1975034506 None] attachment_update completed successfully.
Sep 16 16:26:59 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-aab5fc81-fe0e-44d2-a681-f925c02bf16a req-60b122b7-575b-4b87-ae02-402b5b2f9147 tempest-TestInstancesWithCinderVolumes-1975034506 None] Terminate volume connection completed successfully.
Sep 16 16:26:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-aab5fc81-fe0e-44d2-a681-f925c02bf16a req-60b122b7-575b-4b87-ae02-402b5b2f9147 tempest-TestInstancesWithCinderVolumes-1975034506 None] Deleting attachment e5707d5f-a689-437a-a379-df5e6b9614c7. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:26:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20f32cdd-9f48-4818-b863-1feb96ff354f tempest-TestInstancesWithCinderVolumes-1975034506 None] Acquiring lock "cinder-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:26:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20f32cdd-9f48-4818-b863-1feb96ff354f tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "cinder-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:26:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20f32cdd-9f48-4818-b863-1feb96ff354f tempest-TestInstancesWithCinderVolumes-1975034506 None] Acquiring lock "cinder-quobyte-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:26:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20f32cdd-9f48-4818-b863-1feb96ff354f tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "cinder-quobyte-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030" acquired by "delete_volume" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:26:59 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab53972-d866-48d5-a19f-5693f8f05a7a]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:26:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20f32cdd-9f48-4818-b863-1feb96ff354f tempest-TestInstancesWithCinderVolumes-1975034506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:27:00 devstack sudo[103816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030
Sep 16 16:27:00 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:27:00 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root
Sep 16 16:27:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20f32cdd-9f48-4818-b863-1feb96ff354f tempest-TestInstancesWithCinderVolumes-1975034506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030" returned: 0 in 0.445s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:27:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20f32cdd-9f48-4818-b863-1feb96ff354f tempest-TestInstancesWithCinderVolumes-1975034506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:27:00 devstack sudo[103821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030
Sep 16 16:27:00 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:27:00 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root
Sep 16 16:27:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20f32cdd-9f48-4818-b863-1feb96ff354f tempest-TestInstancesWithCinderVolumes-1975034506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030" returned: 0 in 0.324s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:27:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20f32cdd-9f48-4818-b863-1feb96ff354f tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "cinder-quobyte-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030" released by "delete_volume" :: held 0.819s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:27:00 devstack cinder-volume[86165]: WARNING cinder.quota [None req-20f32cdd-9f48-4818-b863-1feb96ff354f tempest-TestInstancesWithCinderVolumes-1975034506 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1798618971-1359058039 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1798618971-1359058039, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:27:00 devstack cinder-volume[86165]: WARNING cinder.quota [None req-20f32cdd-9f48-4818-b863-1feb96ff354f tempest-TestInstancesWithCinderVolumes-1975034506 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1798618971-1359058039 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1798618971-1359058039, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:27:00 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-20f32cdd-9f48-4818-b863-1feb96ff354f tempest-TestInstancesWithCinderVolumes-1975034506 None] Created reservations ['5ba716a8-e5c7-4a04-a08d-8b1c6e1f30b9', 'ad1502fb-f9a5-4d0a-aed7-c3e998bcb8b8', 'fc3ba4cd-a136-4920-be8b-54deba7510c7', 'a9bdfa3e-0af3-4083-a84f-f4931e4af7a5'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:27:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-20f32cdd-9f48-4818-b863-1feb96ff354f tempest-TestInstancesWithCinderVolumes-1975034506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:27:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-20f32cdd-9f48-4818-b863-1feb96ff354f tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:27:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-20f32cdd-9f48-4818-b863-1feb96ff354f tempest-TestInstancesWithCinderVolumes-1975034506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:27:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-20f32cdd-9f48-4818-b863-1feb96ff354f tempest-TestInstancesWithCinderVolumes-1975034506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:27:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-20f32cdd-9f48-4818-b863-1feb96ff354f tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:27:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20f32cdd-9f48-4818-b863-1feb96ff354f tempest-TestInstancesWithCinderVolumes-1975034506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:27:00 devstack sudo[103825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:27:00 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:27:01 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root
Sep 16 16:27:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-20f32cdd-9f48-4818-b863-1feb96ff354f tempest-TestInstancesWithCinderVolumes-1975034506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.309s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:27:01 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-20f32cdd-9f48-4818-b863-1feb96ff354f tempest-TestInstancesWithCinderVolumes-1975034506 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:27:01 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-20f32cdd-9f48-4818-b863-1feb96ff354f tempest-TestInstancesWithCinderVolumes-1975034506 None] Deleted volume successfully.
Sep 16 16:27:01 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-20f32cdd-9f48-4818-b863-1feb96ff354f tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "cinder-9219e9ba-5fb4-46f4-aa21-bfd5c53d3030-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:27:03 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-5e694275-a18d-4d59-b213-fc78c0dbbf46 req-a40a76fa-9c7d-4379-980b-636d66c95c1c tempest-TestInstancesWithCinderVolumes-1975034506 None] Terminate volume connection completed successfully.
Sep 16 16:27:03 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-5e694275-a18d-4d59-b213-fc78c0dbbf46 req-a40a76fa-9c7d-4379-980b-636d66c95c1c tempest-TestInstancesWithCinderVolumes-1975034506 None] Deleting attachment ab1a5ba6-fc66-45a3-8c95-9d8f8f10db2c. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:27:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6bc3afc3-4649-4e7e-9f58-525a294c42cd tempest-TestInstancesWithCinderVolumes-1975034506 None] Acquiring lock "cinder-ddae6525-1560-48ab-a8ca-74d802269121-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:27:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6bc3afc3-4649-4e7e-9f58-525a294c42cd tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "cinder-ddae6525-1560-48ab-a8ca-74d802269121-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:27:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6bc3afc3-4649-4e7e-9f58-525a294c42cd tempest-TestInstancesWithCinderVolumes-1975034506 None] Acquiring lock "cinder-quobyte-ddae6525-1560-48ab-a8ca-74d802269121" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:27:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6bc3afc3-4649-4e7e-9f58-525a294c42cd tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "cinder-quobyte-ddae6525-1560-48ab-a8ca-74d802269121" acquired by "delete_volume" :: waited 0.023s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:27:04 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b42952-21b3-4b45-80b0-6cbccf817d15]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:27:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6bc3afc3-4649-4e7e-9f58-525a294c42cd tempest-TestInstancesWithCinderVolumes-1975034506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ddae6525-1560-48ab-a8ca-74d802269121 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:27:04 devstack sudo[103887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ddae6525-1560-48ab-a8ca-74d802269121
Sep 16 16:27:04 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:27:05 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root
Sep 16 16:27:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6bc3afc3-4649-4e7e-9f58-525a294c42cd tempest-TestInstancesWithCinderVolumes-1975034506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ddae6525-1560-48ab-a8ca-74d802269121" returned: 0 in 0.473s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:27:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6bc3afc3-4649-4e7e-9f58-525a294c42cd tempest-TestInstancesWithCinderVolumes-1975034506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ddae6525-1560-48ab-a8ca-74d802269121 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:27:05 devstack sudo[103892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ddae6525-1560-48ab-a8ca-74d802269121
Sep 16 16:27:05 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:27:05 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root
Sep 16 16:27:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6bc3afc3-4649-4e7e-9f58-525a294c42cd tempest-TestInstancesWithCinderVolumes-1975034506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ddae6525-1560-48ab-a8ca-74d802269121" returned: 0 in 0.277s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:27:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6bc3afc3-4649-4e7e-9f58-525a294c42cd tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "cinder-quobyte-ddae6525-1560-48ab-a8ca-74d802269121" released by "delete_volume" :: held 0.820s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:27:05 devstack cinder-volume[86165]: WARNING cinder.quota [None req-6bc3afc3-4649-4e7e-9f58-525a294c42cd tempest-TestInstancesWithCinderVolumes-1975034506 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1453956645-776742950 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1453956645-776742950, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:27:05 devstack cinder-volume[86165]: WARNING cinder.quota [None req-6bc3afc3-4649-4e7e-9f58-525a294c42cd tempest-TestInstancesWithCinderVolumes-1975034506 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1453956645-776742950 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1453956645-776742950, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:27:05 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-6bc3afc3-4649-4e7e-9f58-525a294c42cd tempest-TestInstancesWithCinderVolumes-1975034506 None] Created reservations ['4963118c-159f-4589-bd1e-47794ac39733', '8ed8366c-107b-4b50-9e5f-5068976728ed', '5101c0b6-afb1-40be-9fe8-6d0ec50b0ee7', '086bd4cb-5f6f-4c21-a025-90fd0cfa763e'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:27:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6bc3afc3-4649-4e7e-9f58-525a294c42cd tempest-TestInstancesWithCinderVolumes-1975034506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:27:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6bc3afc3-4649-4e7e-9f58-525a294c42cd tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:27:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6bc3afc3-4649-4e7e-9f58-525a294c42cd tempest-TestInstancesWithCinderVolumes-1975034506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:27:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6bc3afc3-4649-4e7e-9f58-525a294c42cd tempest-TestInstancesWithCinderVolumes-1975034506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:27:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6bc3afc3-4649-4e7e-9f58-525a294c42cd tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:27:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6bc3afc3-4649-4e7e-9f58-525a294c42cd tempest-TestInstancesWithCinderVolumes-1975034506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:27:05 devstack sudo[103895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:27:05 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:27:05 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root
Sep 16 16:27:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6bc3afc3-4649-4e7e-9f58-525a294c42cd tempest-TestInstancesWithCinderVolumes-1975034506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.301s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:27:05 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-6bc3afc3-4649-4e7e-9f58-525a294c42cd tempest-TestInstancesWithCinderVolumes-1975034506 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:27:05 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-6bc3afc3-4649-4e7e-9f58-525a294c42cd tempest-TestInstancesWithCinderVolumes-1975034506 None] Deleted volume successfully.
Sep 16 16:27:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6bc3afc3-4649-4e7e-9f58-525a294c42cd tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "cinder-ddae6525-1560-48ab-a8ca-74d802269121-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:27:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:27:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:27:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:27:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:27:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:27:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:27:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:27:07 devstack sudo[103900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:27:07 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:27:07 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root
Sep 16 16:27:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.293s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:27:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:27:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:27:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 29 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:27:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>, <Thread(tpool_thread_0, started daemon 135438770624192)>, <Thread(tpool_thread_1, started daemon 135438762231488)>, <Thread(tpool_thread_2, started daemon 135438753838784)>, <Thread(tpool_thread_3, started daemon 135438745446080)>, <Thread(tpool_thread_4, started daemon 135438737053376)>, <Thread(tpool_thread_5, started daemon 135438728660672)>, <Thread(tpool_thread_6, started daemon 135438720267968)>, <Thread(tpool_thread_7, started daemon 135438711875264)>, <Thread(tpool_thread_8, started daemon 135438703466176)>, <Thread(tpool_thread_9, started daemon 135438695057088)>, <Thread(tpool_thread_10, started daemon 135438686648000)>, <Thread(tpool_thread_11, started daemon 135438678238912)>, <Thread(tpool_thread_12, started daemon 135438669829824)>, <Thread(tpool_thread_13, started daemon 135438661420736)>, <Thread(tpool_thread_14, started daemon 135438653011648)>, <Thread(tpool_thread_15, started daemon 135438644602560)>, <Thread(tpool_thread_16, started daemon 135438636193472)>, <Thread(tpool_thread_17, started daemon 135438627784384)>, <Thread(tpool_thread_18, started daemon 135438619375296)>, <Thread(tpool_thread_19, started daemon 135438610966208)>, <Thread(Rabbit-heartbeat, started daemon 135438772197760)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:27:09 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-51d2fb20-477e-4253-a43d-43021eb159fd req-25d33557-ef94-4f11-ac0d-87bbce3ee89f tempest-TestInstancesWithCinderVolumes-1975034506 None] Terminate volume connection completed successfully.
Sep 16 16:27:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-51d2fb20-477e-4253-a43d-43021eb159fd req-25d33557-ef94-4f11-ac0d-87bbce3ee89f tempest-TestInstancesWithCinderVolumes-1975034506 None] Deleting attachment 5c5fdc79-18b6-450b-8698-85879cf07746. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:27:10 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-89eec100-d097-4560-93fb-b754676cd45b tempest-TestInstancesWithCinderVolumes-1975034506 None] Acquiring lock "cinder-2b566276-6675-481a-96d4-275d94a25b47-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:27:10 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-89eec100-d097-4560-93fb-b754676cd45b tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "cinder-2b566276-6675-481a-96d4-275d94a25b47-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:27:10 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-89eec100-d097-4560-93fb-b754676cd45b tempest-TestInstancesWithCinderVolumes-1975034506 None] Acquiring lock "cinder-quobyte-2b566276-6675-481a-96d4-275d94a25b47" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:27:10 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-89eec100-d097-4560-93fb-b754676cd45b tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "cinder-quobyte-2b566276-6675-481a-96d4-275d94a25b47" acquired by "delete_volume" :: waited 0.015s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:27:10 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[36358e5b-3ffd-4bce-82ad-02d8c27bac1a]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:27:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-89eec100-d097-4560-93fb-b754676cd45b tempest-TestInstancesWithCinderVolumes-1975034506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2b566276-6675-481a-96d4-275d94a25b47 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:27:10 devstack sudo[103931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2b566276-6675-481a-96d4-275d94a25b47
Sep 16 16:27:10 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:27:10 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root
Sep 16 16:27:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-89eec100-d097-4560-93fb-b754676cd45b tempest-TestInstancesWithCinderVolumes-1975034506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2b566276-6675-481a-96d4-275d94a25b47" returned: 0 in 0.405s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:27:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-89eec100-d097-4560-93fb-b754676cd45b tempest-TestInstancesWithCinderVolumes-1975034506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2b566276-6675-481a-96d4-275d94a25b47 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:27:10 devstack sudo[103936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2b566276-6675-481a-96d4-275d94a25b47
Sep 16 16:27:10 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:27:11 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root
Sep 16 16:27:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-89eec100-d097-4560-93fb-b754676cd45b tempest-TestInstancesWithCinderVolumes-1975034506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2b566276-6675-481a-96d4-275d94a25b47" returned: 0 in 0.277s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:27:11 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-89eec100-d097-4560-93fb-b754676cd45b tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "cinder-quobyte-2b566276-6675-481a-96d4-275d94a25b47" released by "delete_volume" :: held 0.727s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:27:11 devstack cinder-volume[86165]: WARNING cinder.quota [None req-89eec100-d097-4560-93fb-b754676cd45b tempest-TestInstancesWithCinderVolumes-1975034506 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1868847473-1280578846 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1868847473-1280578846, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:27:11 devstack cinder-volume[86165]: WARNING cinder.quota [None req-89eec100-d097-4560-93fb-b754676cd45b tempest-TestInstancesWithCinderVolumes-1975034506 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1868847473-1280578846 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1868847473-1280578846, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:27:11 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-89eec100-d097-4560-93fb-b754676cd45b tempest-TestInstancesWithCinderVolumes-1975034506 None] Created reservations ['dcb12464-ac0e-4905-8268-06f3ca410101', '8358b2aa-4b20-4d90-9d0b-2faed0aa6576', 'c8676767-d599-493f-a151-c0d8f56feac7', '80470b58-31ff-4dc9-b235-3ff3440e7dc4'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:27:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-89eec100-d097-4560-93fb-b754676cd45b tempest-TestInstancesWithCinderVolumes-1975034506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:27:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-89eec100-d097-4560-93fb-b754676cd45b tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:27:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-89eec100-d097-4560-93fb-b754676cd45b tempest-TestInstancesWithCinderVolumes-1975034506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:27:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-89eec100-d097-4560-93fb-b754676cd45b tempest-TestInstancesWithCinderVolumes-1975034506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:27:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-89eec100-d097-4560-93fb-b754676cd45b tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:27:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-89eec100-d097-4560-93fb-b754676cd45b tempest-TestInstancesWithCinderVolumes-1975034506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:27:11 devstack sudo[103940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:27:11 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:27:11 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root
Sep 16 16:27:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-89eec100-d097-4560-93fb-b754676cd45b tempest-TestInstancesWithCinderVolumes-1975034506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.240s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:27:11 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-89eec100-d097-4560-93fb-b754676cd45b tempest-TestInstancesWithCinderVolumes-1975034506 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:27:11 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-89eec100-d097-4560-93fb-b754676cd45b tempest-TestInstancesWithCinderVolumes-1975034506 None] Deleted volume successfully.
Sep 16 16:27:11 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-89eec100-d097-4560-93fb-b754676cd45b tempest-TestInstancesWithCinderVolumes-1975034506 None] Lock "cinder-2b566276-6675-481a-96d4-275d94a25b47-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:27:21 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=32,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:27:21 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=30,cinder:UPDATE=28,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Flow 'volume_create_manager' (f978fc6c-253a-4899-9f80-e1b8ff12e9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244a0c44-7e55-4e13-b7ca-62076d217e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244a0c44-7e55-4e13-b7ca-62076d217e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1808692862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f130533-2d0c-496e-bc83-5a20a99b66c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee076952d044c49a9f8bb2436437312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:27:56Z,use_quota=True,user_id='1b4a8c584921428e86f4dd36682591e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d38785-87c8-480b-9718-b2e9a272b25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d38785-87c8-480b-9718-b2e9a272b25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b12a6d-3e57-4a48-8060-89fe3581aa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b12a6d-3e57-4a48-8060-89fe3581aa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f130533-2d0c-496e-bc83-5a20a99b66c3', 'volume_name': 'volume-6f130533-2d0c-496e-bc83-5a20a99b66c3', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8568b8-0003-4ebb-94f5-906dcc5a7567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8568b8-0003-4ebb-94f5-906dcc5a7567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13757594-c220-451d-8524-e4b49caff854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:27:56 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Volume 6f130533-2d0c-496e-bc83-5a20a99b66c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f130533-2d0c-496e-bc83-5a20a99b66c3', 'volume_size': 1}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1808692862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f130533-2d0c-496e-bc83-5a20a99b66c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee076952d044c49a9f8bb2436437312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:27:56Z,use_quota=True,user_id='1b4a8c584921428e86f4dd36682591e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Creating volume 6f130533-2d0c-496e-bc83-5a20a99b66c3 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:27:56 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f130533-2d0c-496e-bc83-5a20a99b66c3 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:27:56 devstack sudo[104068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f130533-2d0c-496e-bc83-5a20a99b66c3 1073741824
Sep 16 16:27:56 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:27:56 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f130533-2d0c-496e-bc83-5a20a99b66c3 1073741824" returned: 0 in 0.466s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f130533-2d0c-496e-bc83-5a20a99b66c3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:27:56 devstack sudo[104074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f130533-2d0c-496e-bc83-5a20a99b66c3
Sep 16 16:27:56 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:27:56 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f130533-2d0c-496e-bc83-5a20a99b66c3" returned: 0 in 0.301s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13757594-c220-451d-8524-e4b49caff854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f130533-2d0c-496e-bc83-5a20a99b66c3', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:27:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4715ea7-bd91-4c14-baf1-ab426ed3765d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:27:57 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Volume volume-6f130533-2d0c-496e-bc83-5a20a99b66c3 (6f130533-2d0c-496e-bc83-5a20a99b66c3): created successfully
Sep 16 16:27:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4715ea7-bd91-4c14-baf1-ab426ed3765d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:27:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Flow 'volume_create_manager' (f978fc6c-253a-4899-9f80-e1b8ff12e9ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:27:57 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b4d76e80-d4a1-4896-bb18-3f80803467c6 tempest-TestMinimumBasicScenario-2093041932 None] Created volume successfully.
Sep 16 16:27:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-800de593-14d5-40e7-ae6e-60f1abee0170 req-64996899-d479-4369-b993-a5b95431eb43 tempest-TestMinimumBasicScenario-2093041932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:27:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-800de593-14d5-40e7-ae6e-60f1abee0170 req-64996899-d479-4369-b993-a5b95431eb43 tempest-TestMinimumBasicScenario-2093041932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:27:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-800de593-14d5-40e7-ae6e-60f1abee0170 req-64996899-d479-4369-b993-a5b95431eb43 tempest-TestMinimumBasicScenario-2093041932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:27:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-800de593-14d5-40e7-ae6e-60f1abee0170 req-64996899-d479-4369-b993-a5b95431eb43 tempest-TestMinimumBasicScenario-2093041932 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-6f130533-2d0c-496e-bc83-5a20a99b66c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35d02eba-2370-42b1-b31c-6487c88af796', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:27:59 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-800de593-14d5-40e7-ae6e-60f1abee0170 req-64996899-d479-4369-b993-a5b95431eb43 tempest-TestMinimumBasicScenario-2093041932 None] attachment_update completed successfully.
Sep 16 16:28:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:28:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:28:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:28:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:28:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:28:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:28:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:28:07 devstack sudo[104578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:28:07 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:28:07 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root
Sep 16 16:28:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.374s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:28:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:28:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:28:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 29 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:28:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>, <Thread(tpool_thread_0, started daemon 135438770624192)>, <Thread(tpool_thread_1, started daemon 135438762231488)>, <Thread(tpool_thread_2, started daemon 135438753838784)>, <Thread(tpool_thread_3, started daemon 135438745446080)>, <Thread(tpool_thread_4, started daemon 135438737053376)>, <Thread(tpool_thread_5, started daemon 135438728660672)>, <Thread(tpool_thread_6, started daemon 135438720267968)>, <Thread(tpool_thread_7, started daemon 135438711875264)>, <Thread(tpool_thread_8, started daemon 135438703466176)>, <Thread(tpool_thread_9, started daemon 135438695057088)>, <Thread(tpool_thread_10, started daemon 135438686648000)>, <Thread(tpool_thread_11, started daemon 135438678238912)>, <Thread(tpool_thread_12, started daemon 135438669829824)>, <Thread(tpool_thread_13, started daemon 135438661420736)>, <Thread(tpool_thread_14, started daemon 135438653011648)>, <Thread(tpool_thread_15, started daemon 135438644602560)>, <Thread(tpool_thread_16, started daemon 135438636193472)>, <Thread(tpool_thread_17, started daemon 135438627784384)>, <Thread(tpool_thread_18, started daemon 135438619375296)>, <Thread(tpool_thread_19, started daemon 135438610966208)>, <Thread(Rabbit-heartbeat, started daemon 135438772197760)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:28:09 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:28:09 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=5,cinder:SELECT=9,cinder:DELETE=1 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:28:46 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-47784212-a459-46eb-b4f0-b984f4bc02ae req-b683f662-9d20-4cb7-99c7-eec8a322d2d1 tempest-TestMinimumBasicScenario-2093041932 None] Terminate volume connection completed successfully.
Sep 16 16:28:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-47784212-a459-46eb-b4f0-b984f4bc02ae req-b683f662-9d20-4cb7-99c7-eec8a322d2d1 tempest-TestMinimumBasicScenario-2093041932 None] Deleting attachment 35d02eba-2370-42b1-b31c-6487c88af796. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:28:47 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-41dc27ba-756a-4bcc-bc56-91a246e7f437 tempest-TestMinimumBasicScenario-2093041932 None] Acquiring lock "cinder-6f130533-2d0c-496e-bc83-5a20a99b66c3-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:28:47 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-41dc27ba-756a-4bcc-bc56-91a246e7f437 tempest-TestMinimumBasicScenario-2093041932 None] Lock "cinder-6f130533-2d0c-496e-bc83-5a20a99b66c3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:28:47 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-41dc27ba-756a-4bcc-bc56-91a246e7f437 tempest-TestMinimumBasicScenario-2093041932 None] Acquiring lock "cinder-quobyte-6f130533-2d0c-496e-bc83-5a20a99b66c3" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:28:47 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-41dc27ba-756a-4bcc-bc56-91a246e7f437 tempest-TestMinimumBasicScenario-2093041932 None] Lock "cinder-quobyte-6f130533-2d0c-496e-bc83-5a20a99b66c3" acquired by "delete_volume" :: waited 0.014s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:28:47 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[43567c07-7067-47ed-9b98-1ea74d831432]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:28:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-41dc27ba-756a-4bcc-bc56-91a246e7f437 tempest-TestMinimumBasicScenario-2093041932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f130533-2d0c-496e-bc83-5a20a99b66c3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:28:48 devstack sudo[104675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f130533-2d0c-496e-bc83-5a20a99b66c3
Sep 16 16:28:48 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:28:48 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root
Sep 16 16:28:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-41dc27ba-756a-4bcc-bc56-91a246e7f437 tempest-TestMinimumBasicScenario-2093041932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f130533-2d0c-496e-bc83-5a20a99b66c3" returned: 0 in 0.402s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:28:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-41dc27ba-756a-4bcc-bc56-91a246e7f437 tempest-TestMinimumBasicScenario-2093041932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f130533-2d0c-496e-bc83-5a20a99b66c3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:28:48 devstack sudo[104680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f130533-2d0c-496e-bc83-5a20a99b66c3
Sep 16 16:28:48 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:28:48 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root
Sep 16 16:28:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-41dc27ba-756a-4bcc-bc56-91a246e7f437 tempest-TestMinimumBasicScenario-2093041932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f130533-2d0c-496e-bc83-5a20a99b66c3" returned: 0 in 0.276s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:28:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-41dc27ba-756a-4bcc-bc56-91a246e7f437 tempest-TestMinimumBasicScenario-2093041932 None] Lock "cinder-quobyte-6f130533-2d0c-496e-bc83-5a20a99b66c3" released by "delete_volume" :: held 0.732s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:28:48 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-41dc27ba-756a-4bcc-bc56-91a246e7f437 tempest-TestMinimumBasicScenario-2093041932 None] Created reservations ['b22be807-364d-4e36-9315-93939e1067d1', '0deb2137-92a0-490d-937e-145724ae4ef4', 'fcde2d8e-9936-4008-bd07-6ee5be360a16', 'f84efb15-61d1-438b-a58b-7a1b8a7dd10b'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:28:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-41dc27ba-756a-4bcc-bc56-91a246e7f437 tempest-TestMinimumBasicScenario-2093041932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:28:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-41dc27ba-756a-4bcc-bc56-91a246e7f437 tempest-TestMinimumBasicScenario-2093041932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:28:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-41dc27ba-756a-4bcc-bc56-91a246e7f437 tempest-TestMinimumBasicScenario-2093041932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:28:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-41dc27ba-756a-4bcc-bc56-91a246e7f437 tempest-TestMinimumBasicScenario-2093041932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:28:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-41dc27ba-756a-4bcc-bc56-91a246e7f437 tempest-TestMinimumBasicScenario-2093041932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:28:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-41dc27ba-756a-4bcc-bc56-91a246e7f437 tempest-TestMinimumBasicScenario-2093041932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:28:48 devstack sudo[104683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:28:48 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:28:49 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root
Sep 16 16:28:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-41dc27ba-756a-4bcc-bc56-91a246e7f437 tempest-TestMinimumBasicScenario-2093041932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.288s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:28:49 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-41dc27ba-756a-4bcc-bc56-91a246e7f437 tempest-TestMinimumBasicScenario-2093041932 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:28:49 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-41dc27ba-756a-4bcc-bc56-91a246e7f437 tempest-TestMinimumBasicScenario-2093041932 None] Deleted volume successfully.
Sep 16 16:28:49 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-41dc27ba-756a-4bcc-bc56-91a246e7f437 tempest-TestMinimumBasicScenario-2093041932 None] Lock "cinder-6f130533-2d0c-496e-bc83-5a20a99b66c3-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:28:58 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:28:59 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=8,cinder:SELECT=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:29:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:29:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:29:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:29:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:29:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:29:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:29:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:29:07 devstack sudo[104753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:29:07 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:29:07 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root
Sep 16 16:29:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.273s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:29:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:29:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:29:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 29 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:29:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>, <Thread(tpool_thread_0, started daemon 135438770624192)>, <Thread(tpool_thread_1, started daemon 135438762231488)>, <Thread(tpool_thread_2, started daemon 135438753838784)>, <Thread(tpool_thread_3, started daemon 135438745446080)>, <Thread(tpool_thread_4, started daemon 135438737053376)>, <Thread(tpool_thread_5, started daemon 135438728660672)>, <Thread(tpool_thread_6, started daemon 135438720267968)>, <Thread(tpool_thread_7, started daemon 135438711875264)>, <Thread(tpool_thread_8, started daemon 135438703466176)>, <Thread(tpool_thread_9, started daemon 135438695057088)>, <Thread(tpool_thread_10, started daemon 135438686648000)>, <Thread(tpool_thread_11, started daemon 135438678238912)>, <Thread(tpool_thread_12, started daemon 135438669829824)>, <Thread(tpool_thread_13, started daemon 135438661420736)>, <Thread(tpool_thread_14, started daemon 135438653011648)>, <Thread(tpool_thread_15, started daemon 135438644602560)>, <Thread(tpool_thread_16, started daemon 135438636193472)>, <Thread(tpool_thread_17, started daemon 135438627784384)>, <Thread(tpool_thread_18, started daemon 135438619375296)>, <Thread(tpool_thread_19, started daemon 135438610966208)>, <Thread(Rabbit-heartbeat, started daemon 135438772197760)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Flow 'volume_create_manager' (d4c4ee17-57e0-4f54-919b-b237cb35935e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ed1786-c896-4662-aa38-2f66fd05e1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ed1786-c896-4662-aa38-2f66fd05e1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1009983967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed371fcc-2f71-42f0-8998-7dfd52b4e642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3343971810b4e5d95eb72fb1bbbefc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:29:29Z,use_quota=True,user_id='f491952fbcef46d181aa8235fd0f4a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d620e942-cc07-4884-b14d-a9c34088b9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d620e942-cc07-4884-b14d-a9c34088b9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a69e236-0d95-47f4-bf89-02019e237a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a69e236-0d95-47f4-bf89-02019e237a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed371fcc-2f71-42f0-8998-7dfd52b4e642', 'volume_name': 'volume-ed371fcc-2f71-42f0-8998-7dfd52b4e642', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377183d3-fb04-4ace-998d-91e7f23da19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377183d3-fb04-4ace-998d-91e7f23da19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c2a9b2-84b4-4a9a-a9a3-292bf7aaf4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:29:29 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Volume ed371fcc-2f71-42f0-8998-7dfd52b4e642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed371fcc-2f71-42f0-8998-7dfd52b4e642', 'volume_size': 1}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1009983967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed371fcc-2f71-42f0-8998-7dfd52b4e642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3343971810b4e5d95eb72fb1bbbefc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:29:29Z,use_quota=True,user_id='f491952fbcef46d181aa8235fd0f4a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Creating volume ed371fcc-2f71-42f0-8998-7dfd52b4e642 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:29:29 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ed371fcc-2f71-42f0-8998-7dfd52b4e642 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:29:29 devstack sudo[104764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ed371fcc-2f71-42f0-8998-7dfd52b4e642 1073741824
Sep 16 16:29:29 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Flow 'volume_create_manager' (049d1733-5c20-4c7e-b055-031b0e4c23e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e142a0a8-2d00-4e49-8bd1-cc8ca66c844e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e142a0a8-2d00-4e49-8bd1-cc8ca66c844e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-6928173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb8eaf6-faee-405b-9c89-520ae5cf5c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3343971810b4e5d95eb72fb1bbbefc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:29:29Z,use_quota=True,user_id='f491952fbcef46d181aa8235fd0f4a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9997bd68-cfd3-4cf1-a1b7-a7c387531c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9997bd68-cfd3-4cf1-a1b7-a7c387531c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cecd7807-45bb-48ad-afbb-78ced5a057f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cecd7807-45bb-48ad-afbb-78ced5a057f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cb8eaf6-faee-405b-9c89-520ae5cf5c19', 'volume_name': 'volume-0cb8eaf6-faee-405b-9c89-520ae5cf5c19', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6113309c-e49e-42a9-b489-0f5beb89b3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6113309c-e49e-42a9-b489-0f5beb89b3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8443a8a1-d06a-4314-9484-07d4f985a179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:29:29 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Volume 0cb8eaf6-faee-405b-9c89-520ae5cf5c19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cb8eaf6-faee-405b-9c89-520ae5cf5c19', 'volume_size': 1}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:29:29 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ed371fcc-2f71-42f0-8998-7dfd52b4e642 1073741824" returned: 0 in 0.563s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:29:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ed371fcc-2f71-42f0-8998-7dfd52b4e642 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:29:29 devstack sudo[104770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ed371fcc-2f71-42f0-8998-7dfd52b4e642
Sep 16 16:29:29 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:29:30 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ed371fcc-2f71-42f0-8998-7dfd52b4e642" returned: 0 in 0.271s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.512s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-6928173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb8eaf6-faee-405b-9c89-520ae5cf5c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3343971810b4e5d95eb72fb1bbbefc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:29:29Z,use_quota=True,user_id='f491952fbcef46d181aa8235fd0f4a5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Creating volume 0cb8eaf6-faee-405b-9c89-520ae5cf5c19 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:29:30 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cb8eaf6-faee-405b-9c89-520ae5cf5c19 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c2a9b2-84b4-4a9a-a9a3-292bf7aaf4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed371fcc-2f71-42f0-8998-7dfd52b4e642', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25f3968-c55c-4ce5-bc1e-0c2156111d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:29:30 devstack sudo[104773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cb8eaf6-faee-405b-9c89-520ae5cf5c19 1073741824
Sep 16 16:29:30 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:29:30 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Volume volume-ed371fcc-2f71-42f0-8998-7dfd52b4e642 (ed371fcc-2f71-42f0-8998-7dfd52b4e642): created successfully
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25f3968-c55c-4ce5-bc1e-0c2156111d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Flow 'volume_create_manager' (d4c4ee17-57e0-4f54-919b-b237cb35935e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:29:30 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-33012683-30b6-4367-936f-89cdbea22484 tempest-TestServerVolumeAttachmentScenario-555781484 None] Created volume successfully.
Sep 16 16:29:30 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cb8eaf6-faee-405b-9c89-520ae5cf5c19 1073741824" returned: 0 in 0.518s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cb8eaf6-faee-405b-9c89-520ae5cf5c19 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:29:30 devstack sudo[104779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cb8eaf6-faee-405b-9c89-520ae5cf5c19
Sep 16 16:29:30 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:29:30 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cb8eaf6-faee-405b-9c89-520ae5cf5c19" returned: 0 in 0.268s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8443a8a1-d06a-4314-9484-07d4f985a179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cb8eaf6-faee-405b-9c89-520ae5cf5c19', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b740521-14bf-49cc-a988-e53b46e00fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:29:30 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Volume volume-0cb8eaf6-faee-405b-9c89-520ae5cf5c19 (0cb8eaf6-faee-405b-9c89-520ae5cf5c19): created successfully
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b740521-14bf-49cc-a988-e53b46e00fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:29:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Flow 'volume_create_manager' (049d1733-5c20-4c7e-b055-031b0e4c23e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:29:30 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-4e584d90-5a43-4231-b365-223f7495d381 tempest-TestServerVolumeAttachmentScenario-555781484 None] Created volume successfully.
Sep 16 16:29:40 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=7,cinder:SELECT=4 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:29:40 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=4,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:30:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-ca319267-4f12-4dc6-b01f-a5e82b620c0d req-ea0d1f57-bfb2-4739-89cc-d3b7bd64d368 tempest-TestServerVolumeAttachmentScenario-555781484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:30:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-ca319267-4f12-4dc6-b01f-a5e82b620c0d req-ea0d1f57-bfb2-4739-89cc-d3b7bd64d368 tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:30:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-ca319267-4f12-4dc6-b01f-a5e82b620c0d req-ea0d1f57-bfb2-4739-89cc-d3b7bd64d368 tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:30:01 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-ca319267-4f12-4dc6-b01f-a5e82b620c0d req-ea0d1f57-bfb2-4739-89cc-d3b7bd64d368 tempest-TestServerVolumeAttachmentScenario-555781484 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-ed371fcc-2f71-42f0-8998-7dfd52b4e642', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cda1fa28-286f-45c9-a03d-7996f7a92526', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:30:01 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-ca319267-4f12-4dc6-b01f-a5e82b620c0d req-ea0d1f57-bfb2-4739-89cc-d3b7bd64d368 tempest-TestServerVolumeAttachmentScenario-555781484 None] attachment_update completed successfully.
Sep 16 16:30:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-547d39f4-b5cf-40ad-a09a-a5e1288d8066 req-3ffc40d6-635c-4299-82b8-9c0b41c4f1fd tempest-TestServerVolumeAttachmentScenario-555781484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:30:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-547d39f4-b5cf-40ad-a09a-a5e1288d8066 req-3ffc40d6-635c-4299-82b8-9c0b41c4f1fd tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:30:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [req-547d39f4-b5cf-40ad-a09a-a5e1288d8066 req-3ffc40d6-635c-4299-82b8-9c0b41c4f1fd tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:30:05 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-547d39f4-b5cf-40ad-a09a-a5e1288d8066 req-3ffc40d6-635c-4299-82b8-9c0b41c4f1fd tempest-TestServerVolumeAttachmentScenario-555781484 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81', 'name': 'volume-0cb8eaf6-faee-405b-9c89-520ae5cf5c19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5149d8bc-8730-4e38-979f-d2ca7349fade', 'enforce_multipath': True} {{(pid=86165) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 16 16:30:05 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-547d39f4-b5cf-40ad-a09a-a5e1288d8066 req-3ffc40d6-635c-4299-82b8-9c0b41c4f1fd tempest-TestServerVolumeAttachmentScenario-555781484 None] attachment_update completed successfully.
Sep 16 16:30:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:30:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:30:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:30:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:30:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:30:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:30:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:07 devstack sudo[105382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:30:07 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:07 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-391c9c8b-2550-4d31-9a50-b704c0be78c5 req-838e433b-31b8-4ab0-a09b-d590fb353b9a tempest-TestServerVolumeAttachmentScenario-555781484 None] Terminate volume connection completed successfully.
Sep 16 16:30:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-391c9c8b-2550-4d31-9a50-b704c0be78c5 req-838e433b-31b8-4ab0-a09b-d590fb353b9a tempest-TestServerVolumeAttachmentScenario-555781484 None] Deleting attachment 5149d8bc-8730-4e38-979f-d2ca7349fade. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:30:07 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.269s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:30:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:30:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 29 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:30:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>, <Thread(tpool_thread_0, started daemon 135438770624192)>, <Thread(tpool_thread_1, started daemon 135438762231488)>, <Thread(tpool_thread_2, started daemon 135438753838784)>, <Thread(tpool_thread_3, started daemon 135438745446080)>, <Thread(tpool_thread_4, started daemon 135438737053376)>, <Thread(tpool_thread_5, started daemon 135438728660672)>, <Thread(tpool_thread_6, started daemon 135438720267968)>, <Thread(tpool_thread_7, started daemon 135438711875264)>, <Thread(tpool_thread_8, started daemon 135438703466176)>, <Thread(tpool_thread_9, started daemon 135438695057088)>, <Thread(tpool_thread_10, started daemon 135438686648000)>, <Thread(tpool_thread_11, started daemon 135438678238912)>, <Thread(tpool_thread_12, started daemon 135438669829824)>, <Thread(tpool_thread_13, started daemon 135438661420736)>, <Thread(tpool_thread_14, started daemon 135438653011648)>, <Thread(tpool_thread_15, started daemon 135438644602560)>, <Thread(tpool_thread_16, started daemon 135438636193472)>, <Thread(tpool_thread_17, started daemon 135438627784384)>, <Thread(tpool_thread_18, started daemon 135438619375296)>, <Thread(tpool_thread_19, started daemon 135438610966208)>, <Thread(Rabbit-heartbeat, started daemon 135438772197760)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:30:08 devstack cinder-volume[86165]: INFO cinder.volume.manager [req-14db36b0-eb5c-4463-9bb7-1156c3bedc34 req-c72d641e-3a3e-4ed3-9d9f-8e731bff8530 tempest-TestServerVolumeAttachmentScenario-555781484 None] Terminate volume connection completed successfully.
Sep 16 16:30:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [req-14db36b0-eb5c-4463-9bb7-1156c3bedc34 req-c72d641e-3a3e-4ed3-9d9f-8e731bff8530 tempest-TestServerVolumeAttachmentScenario-555781484 None] Deleting attachment cda1fa28-286f-45c9-a03d-7996f7a92526. {{(pid=86165) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 16 16:30:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1a647d1e-ee66-49ef-9a8a-9f228dafb40e tempest-TestServerVolumeAttachmentScenario-555781484 None] Acquiring lock "cinder-0cb8eaf6-faee-405b-9c89-520ae5cf5c19-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:30:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1a647d1e-ee66-49ef-9a8a-9f228dafb40e tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "cinder-0cb8eaf6-faee-405b-9c89-520ae5cf5c19-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:30:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1a647d1e-ee66-49ef-9a8a-9f228dafb40e tempest-TestServerVolumeAttachmentScenario-555781484 None] Acquiring lock "cinder-quobyte-0cb8eaf6-faee-405b-9c89-520ae5cf5c19" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:30:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1a647d1e-ee66-49ef-9a8a-9f228dafb40e tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "cinder-quobyte-0cb8eaf6-faee-405b-9c89-520ae5cf5c19" acquired by "delete_volume" :: waited 0.015s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:30:13 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[17afaca4-ef90-46f5-a753-6db5a800825f]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:30:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1a647d1e-ee66-49ef-9a8a-9f228dafb40e tempest-TestServerVolumeAttachmentScenario-555781484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cb8eaf6-faee-405b-9c89-520ae5cf5c19 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:13 devstack sudo[105445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cb8eaf6-faee-405b-9c89-520ae5cf5c19
Sep 16 16:30:13 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:14 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1a647d1e-ee66-49ef-9a8a-9f228dafb40e tempest-TestServerVolumeAttachmentScenario-555781484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cb8eaf6-faee-405b-9c89-520ae5cf5c19" returned: 0 in 0.437s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1a647d1e-ee66-49ef-9a8a-9f228dafb40e tempest-TestServerVolumeAttachmentScenario-555781484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cb8eaf6-faee-405b-9c89-520ae5cf5c19 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:14 devstack sudo[105450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cb8eaf6-faee-405b-9c89-520ae5cf5c19
Sep 16 16:30:14 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:14 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1a647d1e-ee66-49ef-9a8a-9f228dafb40e tempest-TestServerVolumeAttachmentScenario-555781484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cb8eaf6-faee-405b-9c89-520ae5cf5c19" returned: 0 in 0.258s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1a647d1e-ee66-49ef-9a8a-9f228dafb40e tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "cinder-quobyte-0cb8eaf6-faee-405b-9c89-520ae5cf5c19" released by "delete_volume" :: held 0.749s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:30:14 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-1a647d1e-ee66-49ef-9a8a-9f228dafb40e tempest-TestServerVolumeAttachmentScenario-555781484 None] Created reservations ['d6eaa24b-d27e-4267-9948-8f2af76f2602', '8b039cf2-14cf-43bb-b3a7-21680dbcffac', '459d10cb-6929-4443-a05d-206ac9cbf354', '6b869886-b81b-47dc-b969-01a461a4f770'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:30:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1a647d1e-ee66-49ef-9a8a-9f228dafb40e tempest-TestServerVolumeAttachmentScenario-555781484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:30:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1a647d1e-ee66-49ef-9a8a-9f228dafb40e tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:30:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1a647d1e-ee66-49ef-9a8a-9f228dafb40e tempest-TestServerVolumeAttachmentScenario-555781484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:30:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1a647d1e-ee66-49ef-9a8a-9f228dafb40e tempest-TestServerVolumeAttachmentScenario-555781484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:30:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1a647d1e-ee66-49ef-9a8a-9f228dafb40e tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:30:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1a647d1e-ee66-49ef-9a8a-9f228dafb40e tempest-TestServerVolumeAttachmentScenario-555781484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:14 devstack sudo[105453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:30:14 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c1c28ed5-1a05-4b52-9d3a-8f408d3680a5 tempest-TestServerVolumeAttachmentScenario-555781484 None] Acquiring lock "cinder-ed371fcc-2f71-42f0-8998-7dfd52b4e642-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:30:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c1c28ed5-1a05-4b52-9d3a-8f408d3680a5 tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "cinder-ed371fcc-2f71-42f0-8998-7dfd52b4e642-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:30:14 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1a647d1e-ee66-49ef-9a8a-9f228dafb40e tempest-TestServerVolumeAttachmentScenario-555781484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.311s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:14 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-1a647d1e-ee66-49ef-9a8a-9f228dafb40e tempest-TestServerVolumeAttachmentScenario-555781484 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:30:14 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-1a647d1e-ee66-49ef-9a8a-9f228dafb40e tempest-TestServerVolumeAttachmentScenario-555781484 None] Deleted volume successfully.
Sep 16 16:30:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c1c28ed5-1a05-4b52-9d3a-8f408d3680a5 tempest-TestServerVolumeAttachmentScenario-555781484 None] Acquiring lock "cinder-quobyte-ed371fcc-2f71-42f0-8998-7dfd52b4e642" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:30:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1a647d1e-ee66-49ef-9a8a-9f228dafb40e tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "cinder-0cb8eaf6-faee-405b-9c89-520ae5cf5c19-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:30:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c1c28ed5-1a05-4b52-9d3a-8f408d3680a5 tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "cinder-quobyte-ed371fcc-2f71-42f0-8998-7dfd52b4e642" acquired by "delete_volume" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:30:14 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fc6676-968c-4032-815c-cc7198f8c107]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:30:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c1c28ed5-1a05-4b52-9d3a-8f408d3680a5 tempest-TestServerVolumeAttachmentScenario-555781484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ed371fcc-2f71-42f0-8998-7dfd52b4e642 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:14 devstack sudo[105456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ed371fcc-2f71-42f0-8998-7dfd52b4e642
Sep 16 16:30:14 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:15 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c1c28ed5-1a05-4b52-9d3a-8f408d3680a5 tempest-TestServerVolumeAttachmentScenario-555781484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ed371fcc-2f71-42f0-8998-7dfd52b4e642" returned: 0 in 0.377s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c1c28ed5-1a05-4b52-9d3a-8f408d3680a5 tempest-TestServerVolumeAttachmentScenario-555781484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ed371fcc-2f71-42f0-8998-7dfd52b4e642 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:15 devstack sudo[105461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ed371fcc-2f71-42f0-8998-7dfd52b4e642
Sep 16 16:30:15 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:15 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c1c28ed5-1a05-4b52-9d3a-8f408d3680a5 tempest-TestServerVolumeAttachmentScenario-555781484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ed371fcc-2f71-42f0-8998-7dfd52b4e642" returned: 0 in 0.263s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c1c28ed5-1a05-4b52-9d3a-8f408d3680a5 tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "cinder-quobyte-ed371fcc-2f71-42f0-8998-7dfd52b4e642" released by "delete_volume" :: held 0.684s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:30:15 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-c1c28ed5-1a05-4b52-9d3a-8f408d3680a5 tempest-TestServerVolumeAttachmentScenario-555781484 None] Created reservations ['8e95a564-cf3c-4e05-bc5f-ca8ba9bb3170', '4c5ffef8-212b-445e-8074-87fd539bb784', '111ca5a9-a1d1-4e63-835c-ba46ae678259', 'a62c7ad0-eca4-46da-a915-02efb5101246'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:30:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c1c28ed5-1a05-4b52-9d3a-8f408d3680a5 tempest-TestServerVolumeAttachmentScenario-555781484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:30:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c1c28ed5-1a05-4b52-9d3a-8f408d3680a5 tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:30:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c1c28ed5-1a05-4b52-9d3a-8f408d3680a5 tempest-TestServerVolumeAttachmentScenario-555781484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:30:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c1c28ed5-1a05-4b52-9d3a-8f408d3680a5 tempest-TestServerVolumeAttachmentScenario-555781484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:30:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c1c28ed5-1a05-4b52-9d3a-8f408d3680a5 tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:30:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c1c28ed5-1a05-4b52-9d3a-8f408d3680a5 tempest-TestServerVolumeAttachmentScenario-555781484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:15 devstack sudo[105464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:30:15 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:15 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c1c28ed5-1a05-4b52-9d3a-8f408d3680a5 tempest-TestServerVolumeAttachmentScenario-555781484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.262s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:15 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-c1c28ed5-1a05-4b52-9d3a-8f408d3680a5 tempest-TestServerVolumeAttachmentScenario-555781484 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:30:15 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c1c28ed5-1a05-4b52-9d3a-8f408d3680a5 tempest-TestServerVolumeAttachmentScenario-555781484 None] Deleted volume successfully.
Sep 16 16:30:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-c1c28ed5-1a05-4b52-9d3a-8f408d3680a5 tempest-TestServerVolumeAttachmentScenario-555781484 None] Lock "cinder-ed371fcc-2f71-42f0-8998-7dfd52b4e642-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:30:25 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=26,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:30:25 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=24,cinder:UPDATE=15,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:30:32 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:30:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Flow 'volume_create_manager' (2ff352be-5baa-44e9-8e9d-902f5b4523f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:30:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e813d86d-c7b8-44b9-933f-a8e118c2bc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:30:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e813d86d-c7b8-44b9-933f-a8e118c2bc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857243bd-bc60-41f1-8ae1-c3774c99c02a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c1c673052440a1bb98e23b8e55af14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:30:33Z,use_quota=True,user_id='6151102cb6e046889a8597c9b7c013b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d634fb7-351e-447d-91b5-0b2f2446ab8f),volume_type_id=0d634fb7-351e-447d-91b5-0b2f2446ab8f)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:30:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a91b8b-9541-4496-acc5-3a07ac497f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:30:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a91b8b-9541-4496-acc5-3a07ac497f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:30:32 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c839708-af72-47d8-8fe4-52a1426c5d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:30:32 devstack cinder-volume[86165]: DEBUG cinder.image.glance [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Creating Keystone auth plugin from conf {{(pid=86165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 16:30:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c839708-af72-47d8-8fe4-52a1426c5d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '857243bd-bc60-41f1-8ae1-c3774c99c02a', 'volume_name': 'volume-857243bd-bc60-41f1-8ae1-c3774c99c02a', 'volume_size': 1, 'image_id': '95a3ad88-3a73-41c7-a6f3-3329339d0cfa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95a3ad88-3a73-41c7-a6f3-3329339d0cfa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a3f3a5e95e7f896b4965b5ee841f7f23', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '63c1c673052440a1bb98e23b8e55af14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '06d3aee0d8ed540311ad5deeda2b8b9a44a2b39603f4bdd7d747058cd535fd6907c734dca1b21017f5002d45dc6137d9f88e767cf95026ff38eb7af8e8b46235', 'id': '95a3ad88-3a73-41c7-a6f3-3329339d0cfa', 'created_at': datetime.datetime(2026, 9, 16, 14, 30, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 30, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95a3ad88-3a73-41c7-a6f3-3329339d0cfa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e4bf1bad0>}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:30:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d96c9dcf-e257-4bcd-9ccc-017339936a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:30:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d96c9dcf-e257-4bcd-9ccc-017339936a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:30:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9185aa3-21ca-41e2-8d11-f7abe17109c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:30:33 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Volume 857243bd-bc60-41f1-8ae1-c3774c99c02a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-857243bd-bc60-41f1-8ae1-c3774c99c02a', 'volume_size': 1, 'image_id': '95a3ad88-3a73-41c7-a6f3-3329339d0cfa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95a3ad88-3a73-41c7-a6f3-3329339d0cfa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a3f3a5e95e7f896b4965b5ee841f7f23', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '63c1c673052440a1bb98e23b8e55af14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '06d3aee0d8ed540311ad5deeda2b8b9a44a2b39603f4bdd7d747058cd535fd6907c734dca1b21017f5002d45dc6137d9f88e767cf95026ff38eb7af8e8b46235', 'id': '95a3ad88-3a73-41c7-a6f3-3329339d0cfa', 'created_at': datetime.datetime(2026, 9, 16, 14, 30, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 30, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95a3ad88-3a73-41c7-a6f3-3329339d0cfa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e4bf1bad0>}
Sep 16 16:30:33 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Trying to clone 857243bd-bc60-41f1-8ae1-c3774c99c02a from image 95a3ad88-3a73-41c7-a6f3-3329339d0cfa at location (None, [{'url': 'file:///opt/stack/data/glance/images/95a3ad88-3a73-41c7-a6f3-3329339d0cfa', 'metadata': {}}]). {{(pid=86165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 16:30:33 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 16:30:33 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Image download 0.00 MB at 0.00 MB/s
Sep 16 16:30:33 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29717f3-ecd2-4303-aa6f-c82ffd77a460]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:30:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:33 devstack sudo[105473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD
Sep 16 16:30:33 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:33 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD" returned: 0 in 0.336s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:33 devstack sudo[105477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD
Sep 16 16:30:33 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:33 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD" returned: 1 in 0.366s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:30:33 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Temporary image 95a3ad88-3a73-41c7-a6f3-3329339d0cfa is fetched for user 6151102cb6e046889a8597c9b7c013b1. {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 16:30:34 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb411e4-65b9-475c-a754-087d43775b1c]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:30:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:34 devstack sudo[105482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD
Sep 16 16:30:34 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:34 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD" returned: 0 in 0.365s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:34 devstack sudo[105486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD
Sep 16 16:30:34 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:34 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD" returned: 1 in 0.324s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:30:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:30:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:30:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857243bd-bc60-41f1-8ae1-c3774c99c02a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63c1c673052440a1bb98e23b8e55af14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:30:33Z,use_quota=True,user_id='6151102cb6e046889a8597c9b7c013b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d634fb7-351e-447d-91b5-0b2f2446ab8f),volume_type_id=0d634fb7-351e-447d-91b5-0b2f2446ab8f)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:30:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Creating volume 857243bd-bc60-41f1-8ae1-c3774c99c02a {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:30:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:30:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:30:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:30:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:30:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:30:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:30:34 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:30:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-857243bd-bc60-41f1-8ae1-c3774c99c02a 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:34 devstack sudo[105491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-857243bd-bc60-41f1-8ae1-c3774c99c02a 1073741824
Sep 16 16:30:34 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:35 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-857243bd-bc60-41f1-8ae1-c3774c99c02a 1073741824" returned: 0 in 0.478s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-857243bd-bc60-41f1-8ae1-c3774c99c02a {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:35 devstack sudo[105497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-857243bd-bc60-41f1-8ae1-c3774c99c02a
Sep 16 16:30:35 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:35 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-857243bd-bc60-41f1-8ae1-c3774c99c02a" returned: 0 in 0.259s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:30:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:30:35 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Attempting download of 95a3ad88-3a73-41c7-a6f3-3329339d0cfa ((None, [{'url': 'file:///opt/stack/data/glance/images/95a3ad88-3a73-41c7-a6f3-3329339d0cfa', 'metadata': {}}])) to volume 857243bd-bc60-41f1-8ae1-c3774c99c02a. {{(pid=86165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 16:30:35 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e305304-21e7-4098-bc2d-e3a381d23922]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:30:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_demqgm8u {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:35 devstack sudo[105500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_demqgm8u
Sep 16 16:30:35 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:35 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_demqgm8u" returned: 0 in 0.366s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_demqgm8u {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:36 devstack sudo[105504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_demqgm8u
Sep 16 16:30:36 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:36 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_demqgm8u" returned: 1 in 0.340s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_demqgm8u' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:30:36 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f893c534-2bd5-4cb5-8034-2acf90d86c65]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:30:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:36 devstack sudo[105508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD
Sep 16 16:30:36 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:36 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD" returned: 0 in 0.332s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:36 devstack sudo[105512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD
Sep 16 16:30:36 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:36 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD" returned: 1 in 0.340s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:30:36 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] 95a3ad88-3a73-41c7-a6f3-3329339d0cfa was raw, converting to qcow2 {{(pid=86165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 16:30:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-857243bd-bc60-41f1-8ae1-c3774c99c02a {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:37 devstack sudo[105517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-857243bd-bc60-41f1-8ae1-c3774c99c02a
Sep 16 16:30:37 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:37 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-857243bd-bc60-41f1-8ae1-c3774c99c02a" returned: 0 in 0.468s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:37 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_95a3ad88-3a73-41c7-a6f3-3329339d0cfa_kd84jhl9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-857243bd-bc60-41f1-8ae1-c3774c99c02a {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:30:37 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Converted 0.00 MB image at 0.00 MB/s
Sep 16 16:30:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-857243bd-bc60-41f1-8ae1-c3774c99c02a 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:37 devstack sudo[105524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-857243bd-bc60-41f1-8ae1-c3774c99c02a 1G
Sep 16 16:30:37 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:37 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-857243bd-bc60-41f1-8ae1-c3774c99c02a 1G" returned: 0 in 0.313s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:37 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Downloaded image 95a3ad88-3a73-41c7-a6f3-3329339d0cfa ((None, [{'url': 'file:///opt/stack/data/glance/images/95a3ad88-3a73-41c7-a6f3-3329339d0cfa', 'metadata': {}}])) to volume 857243bd-bc60-41f1-8ae1-c3774c99c02a successfully. {{(pid=86165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 16:30:37 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Temporary image 95a3ad88-3a73-41c7-a6f3-3329339d0cfa for user 6151102cb6e046889a8597c9b7c013b1 is deleted. {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 16:30:37 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Marking volume 857243bd-bc60-41f1-8ae1-c3774c99c02a as bootable. {{(pid=86165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 16:30:37 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Copying metadata from image 95a3ad88-3a73-41c7-a6f3-3329339d0cfa to 857243bd-bc60-41f1-8ae1-c3774c99c02a. {{(pid=86165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 16:30:37 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Creating volume glance metadata for volume 857243bd-bc60-41f1-8ae1-c3774c99c02a backed by image 95a3ad88-3a73-41c7-a6f3-3329339d0cfa with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '95a3ad88-3a73-41c7-a6f3-3329339d0cfa', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a3f3a5e95e7f896b4965b5ee841f7f23', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 16:30:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9185aa3-21ca-41e2-8d11-f7abe17109c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-857243bd-bc60-41f1-8ae1-c3774c99c02a', 'volume_size': 1, 'image_id': '95a3ad88-3a73-41c7-a6f3-3329339d0cfa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95a3ad88-3a73-41c7-a6f3-3329339d0cfa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a3f3a5e95e7f896b4965b5ee841f7f23', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '63c1c673052440a1bb98e23b8e55af14', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '06d3aee0d8ed540311ad5deeda2b8b9a44a2b39603f4bdd7d747058cd535fd6907c734dca1b21017f5002d45dc6137d9f88e767cf95026ff38eb7af8e8b46235', 'id': '95a3ad88-3a73-41c7-a6f3-3329339d0cfa', 'created_at': datetime.datetime(2026, 9, 16, 14, 30, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 30, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95a3ad88-3a73-41c7-a6f3-3329339d0cfa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e4bf1bad0>}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:30:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70caed5c-8eeb-40b8-abeb-185117c125a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:30:37 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Volume volume-857243bd-bc60-41f1-8ae1-c3774c99c02a (857243bd-bc60-41f1-8ae1-c3774c99c02a): created successfully
Sep 16 16:30:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70caed5c-8eeb-40b8-abeb-185117c125a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:30:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Flow 'volume_create_manager' (2ff352be-5baa-44e9-8e9d-902f5b4523f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:30:37 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-c9dff738-3055-4c50-91cd-35ab6a7cd5cd tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Created volume successfully.
Sep 16 16:30:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0a2e971e-c3f5-4c04-b125-16c7259ed882 tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Acquiring lock "cinder-857243bd-bc60-41f1-8ae1-c3774c99c02a-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:30:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0a2e971e-c3f5-4c04-b125-16c7259ed882 tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Lock "cinder-857243bd-bc60-41f1-8ae1-c3774c99c02a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:30:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0a2e971e-c3f5-4c04-b125-16c7259ed882 tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Acquiring lock "cinder-quobyte-857243bd-bc60-41f1-8ae1-c3774c99c02a" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:30:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0a2e971e-c3f5-4c04-b125-16c7259ed882 tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Lock "cinder-quobyte-857243bd-bc60-41f1-8ae1-c3774c99c02a" acquired by "delete_volume" :: waited 0.014s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:30:38 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d86bf37-19ab-472b-8fa8-2447011df5f5]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:30:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0a2e971e-c3f5-4c04-b125-16c7259ed882 tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-857243bd-bc60-41f1-8ae1-c3774c99c02a {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:38 devstack sudo[105529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-857243bd-bc60-41f1-8ae1-c3774c99c02a
Sep 16 16:30:38 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:38 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0a2e971e-c3f5-4c04-b125-16c7259ed882 tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-857243bd-bc60-41f1-8ae1-c3774c99c02a" returned: 0 in 0.362s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0a2e971e-c3f5-4c04-b125-16c7259ed882 tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-857243bd-bc60-41f1-8ae1-c3774c99c02a {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:38 devstack sudo[105534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-857243bd-bc60-41f1-8ae1-c3774c99c02a
Sep 16 16:30:38 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:38 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0a2e971e-c3f5-4c04-b125-16c7259ed882 tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-857243bd-bc60-41f1-8ae1-c3774c99c02a" returned: 0 in 0.306s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0a2e971e-c3f5-4c04-b125-16c7259ed882 tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Lock "cinder-quobyte-857243bd-bc60-41f1-8ae1-c3774c99c02a" released by "delete_volume" :: held 0.717s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:30:38 devstack cinder-volume[86165]: WARNING cinder.quota [None req-0a2e971e-c3f5-4c04-b125-16c7259ed882 tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:30:38 devstack cinder-volume[86165]: WARNING cinder.quota [None req-0a2e971e-c3f5-4c04-b125-16c7259ed882 tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 16 16:30:39 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-0a2e971e-c3f5-4c04-b125-16c7259ed882 tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Created reservations ['d4382460-20be-471e-b340-bfece31b1353', '8ad4f277-2f96-4e0a-a83b-22a445bb8f5c', '0c659361-55f9-45ed-aa11-2e2bc4bf76cf', '1e2aae02-584a-4f3f-98b1-6477f5fba21f'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:30:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0a2e971e-c3f5-4c04-b125-16c7259ed882 tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:30:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0a2e971e-c3f5-4c04-b125-16c7259ed882 tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:30:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0a2e971e-c3f5-4c04-b125-16c7259ed882 tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:30:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0a2e971e-c3f5-4c04-b125-16c7259ed882 tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:30:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0a2e971e-c3f5-4c04-b125-16c7259ed882 tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:30:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0a2e971e-c3f5-4c04-b125-16c7259ed882 tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:39 devstack sudo[105537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:30:39 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:39 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0a2e971e-c3f5-4c04-b125-16c7259ed882 tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.304s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:39 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-0a2e971e-c3f5-4c04-b125-16c7259ed882 tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:30:39 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-0a2e971e-c3f5-4c04-b125-16c7259ed882 tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Deleted volume successfully.
Sep 16 16:30:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0a2e971e-c3f5-4c04-b125-16c7259ed882 tempest-VolumeAndVolumeTypeFromImageTest-1958180853 None] Lock "cinder-857243bd-bc60-41f1-8ae1-c3774c99c02a-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:30:43 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:30:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Flow 'volume_create_manager' (0bd4b5ca-db5a-4a33-99a1-a833204cac2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:30:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74bb9634-3278-4813-930c-ad01715dad8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:30:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74bb9634-3278-4813-930c-ad01715dad8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5301947f-e6b8-4676-9492-fd1e72ff2a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758e6f63375946eaa07f6b4d7d360a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:30:44Z,use_quota=True,user_id='bdd7164d6aaf430abb4e9cb29d200de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:30:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a346eac4-7a98-4855-88b6-5aa585534b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:30:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a346eac4-7a98-4855-88b6-5aa585534b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:30:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084ed117-6a59-43eb-93e6-b289675c3ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:30:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084ed117-6a59-43eb-93e6-b289675c3ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5301947f-e6b8-4676-9492-fd1e72ff2a3c', 'volume_name': 'volume-5301947f-e6b8-4676-9492-fd1e72ff2a3c', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:30:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b5ca5b3-794c-4528-afc7-a202ef51fab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:30:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b5ca5b3-794c-4528-afc7-a202ef51fab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:30:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d07201-a139-4ea2-90fb-bb8bcf452bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:30:43 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Volume 5301947f-e6b8-4676-9492-fd1e72ff2a3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5301947f-e6b8-4676-9492-fd1e72ff2a3c', 'volume_size': 1}
Sep 16 16:30:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:30:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:30:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5301947f-e6b8-4676-9492-fd1e72ff2a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758e6f63375946eaa07f6b4d7d360a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:30:44Z,use_quota=True,user_id='bdd7164d6aaf430abb4e9cb29d200de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:30:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Creating volume 5301947f-e6b8-4676-9492-fd1e72ff2a3c {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:30:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:30:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:30:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:30:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:30:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:30:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:30:43 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:30:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5301947f-e6b8-4676-9492-fd1e72ff2a3c 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:44 devstack sudo[105543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5301947f-e6b8-4676-9492-fd1e72ff2a3c 1073741824
Sep 16 16:30:44 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:44 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5301947f-e6b8-4676-9492-fd1e72ff2a3c 1073741824" returned: 0 in 0.449s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5301947f-e6b8-4676-9492-fd1e72ff2a3c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:44 devstack sudo[105549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5301947f-e6b8-4676-9492-fd1e72ff2a3c
Sep 16 16:30:44 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:44 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5301947f-e6b8-4676-9492-fd1e72ff2a3c" returned: 0 in 0.256s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:30:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:30:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d07201-a139-4ea2-90fb-bb8bcf452bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5301947f-e6b8-4676-9492-fd1e72ff2a3c', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:30:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca8271b-92be-4a86-9546-51c9ecda4f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:30:44 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Volume volume-5301947f-e6b8-4676-9492-fd1e72ff2a3c (5301947f-e6b8-4676-9492-fd1e72ff2a3c): created successfully
Sep 16 16:30:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca8271b-92be-4a86-9546-51c9ecda4f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:30:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Flow 'volume_create_manager' (0bd4b5ca-db5a-4a33-99a1-a833204cac2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:30:44 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-63282d94-405d-43f1-8660-50b8e6f475f4 tempest-CinderUnicodeTest-282383181 None] Created volume successfully.
Sep 16 16:30:46 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:30:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Flow 'volume_create_manager' (66fcc689-87bf-49ca-8af2-2e66e9790ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:30:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (577779a7-71e8-4fba-b5e4-6fa23f4dbe99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:30:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (577779a7-71e8-4fba-b5e4-6fa23f4dbe99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:30:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1124142230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758e6f63375946eaa07f6b4d7d360a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:30:46Z,use_quota=True,user_id='bdd7164d6aaf430abb4e9cb29d200de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:30:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0531d6-d2b4-4c07-b1f6-402090c76a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:30:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0531d6-d2b4-4c07-b1f6-402090c76a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:30:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3196e8a5-ba51-40d8-b4b1-4c492774788f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:30:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3196e8a5-ba51-40d8-b4b1-4c492774788f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b', 'volume_name': 'volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:30:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a8490a-845e-48d3-a16a-3c38e0715cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:30:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a8490a-845e-48d3-a16a-3c38e0715cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:30:46 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c940ce-28ea-4928-b1d3-8286057b95fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:30:46 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Volume b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b', 'volume_size': 1}
Sep 16 16:30:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:30:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:30:46 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:30:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1124142230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758e6f63375946eaa07f6b4d7d360a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:30:46Z,use_quota=True,user_id='bdd7164d6aaf430abb4e9cb29d200de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:30:46 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Creating volume b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:30:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:30:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:30:46 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:30:46 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:30:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:30:46 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:30:46 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:30:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:46 devstack sudo[105552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b 1073741824
Sep 16 16:30:46 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:47 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b 1073741824" returned: 0 in 0.479s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:47 devstack sudo[105557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b
Sep 16 16:30:47 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:47 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b" returned: 0 in 0.254s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:30:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:30:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c940ce-28ea-4928-b1d3-8286057b95fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:30:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8dc6292-b7ca-453c-836c-ef89d2b6b0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:30:47 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Volume volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b (b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b): created successfully
Sep 16 16:30:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8dc6292-b7ca-453c-836c-ef89d2b6b0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:30:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Flow 'volume_create_manager' (66fcc689-87bf-49ca-8af2-2e66e9790ce2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:30:47 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-0633545b-769d-4e83-abb0-1ca86736149e tempest-CinderUnicodeTest-282383181 None] Created volume successfully.
Sep 16 16:30:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9cf1d69c-5a62-4080-b621-0b8d6116f064 tempest-CinderUnicodeTest-282383181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:30:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9cf1d69c-5a62-4080-b621-0b8d6116f064 tempest-CinderUnicodeTest-282383181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:30:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-9cf1d69c-5a62-4080-b621-0b8d6116f064 tempest-CinderUnicodeTest-282383181 None] Creating offline snapshot d0e80d7e-8f48-4418-960f-0ff9fbfdba5f of volume b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:30:47 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[32983b8d-4f0b-493c-aa28-0a9f00469c93]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:30:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9cf1d69c-5a62-4080-b621-0b8d6116f064 tempest-CinderUnicodeTest-282383181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:47 devstack sudo[105560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b
Sep 16 16:30:47 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:48 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9cf1d69c-5a62-4080-b621-0b8d6116f064 tempest-CinderUnicodeTest-282383181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b" returned: 0 in 0.422s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9cf1d69c-5a62-4080-b621-0b8d6116f064 tempest-CinderUnicodeTest-282383181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.d0e80d7e-8f48-4418-960f-0ff9fbfdba5f 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:48 devstack sudo[105565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.d0e80d7e-8f48-4418-960f-0ff9fbfdba5f 1G
Sep 16 16:30:48 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:48 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9cf1d69c-5a62-4080-b621-0b8d6116f064 tempest-CinderUnicodeTest-282383181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.d0e80d7e-8f48-4418-960f-0ff9fbfdba5f 1G" returned: 0 in 0.439s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9cf1d69c-5a62-4080-b621-0b8d6116f064 tempest-CinderUnicodeTest-282383181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.d0e80d7e-8f48-4418-960f-0ff9fbfdba5f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:48 devstack sudo[105571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.d0e80d7e-8f48-4418-960f-0ff9fbfdba5f
Sep 16 16:30:48 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:49 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9cf1d69c-5a62-4080-b621-0b8d6116f064 tempest-CinderUnicodeTest-282383181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.d0e80d7e-8f48-4418-960f-0ff9fbfdba5f" returned: 0 in 0.321s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:49 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-9cf1d69c-5a62-4080-b621-0b8d6116f064 tempest-CinderUnicodeTest-282383181 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.d0e80d7e-8f48-4418-960f-0ff9fbfdba5f is being set with open permissions: ugo+rw
Sep 16 16:30:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9cf1d69c-5a62-4080-b621-0b8d6116f064 tempest-CinderUnicodeTest-282383181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.d0e80d7e-8f48-4418-960f-0ff9fbfdba5f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:49 devstack sudo[105576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.d0e80d7e-8f48-4418-960f-0ff9fbfdba5f
Sep 16 16:30:49 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:49 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9cf1d69c-5a62-4080-b621-0b8d6116f064 tempest-CinderUnicodeTest-282383181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.d0e80d7e-8f48-4418-960f-0ff9fbfdba5f" returned: 0 in 0.276s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9cf1d69c-5a62-4080-b621-0b8d6116f064 tempest-CinderUnicodeTest-282383181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:49 devstack sudo[105579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.info
Sep 16 16:30:49 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:49 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9cf1d69c-5a62-4080-b621-0b8d6116f064 tempest-CinderUnicodeTest-282383181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.info" returned: 0 in 0.287s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:49 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-9cf1d69c-5a62-4080-b621-0b8d6116f064 tempest-CinderUnicodeTest-282383181 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.info is being set with open permissions: ugo+rw
Sep 16 16:30:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9cf1d69c-5a62-4080-b621-0b8d6116f064 tempest-CinderUnicodeTest-282383181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:49 devstack sudo[105582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.info
Sep 16 16:30:49 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:49 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9cf1d69c-5a62-4080-b621-0b8d6116f064 tempest-CinderUnicodeTest-282383181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.info" returned: 0 in 0.281s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9cf1d69c-5a62-4080-b621-0b8d6116f064 tempest-CinderUnicodeTest-282383181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.129s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:30:49 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-9cf1d69c-5a62-4080-b621-0b8d6116f064 tempest-CinderUnicodeTest-282383181 None] Create snapshot completed successfully
Sep 16 16:30:51 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a1942538-11d9-400c-bd7b-5c2f4ce25aa4 tempest-CinderUnicodeTest-282383181 None] Acquiring lock "cinder-d0e80d7e-8f48-4418-960f-0ff9fbfdba5f-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:30:51 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a1942538-11d9-400c-bd7b-5c2f4ce25aa4 tempest-CinderUnicodeTest-282383181 None] Lock "cinder-d0e80d7e-8f48-4418-960f-0ff9fbfdba5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:30:51 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a1942538-11d9-400c-bd7b-5c2f4ce25aa4 tempest-CinderUnicodeTest-282383181 None] Acquiring lock "cinder-quobyte-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:30:51 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a1942538-11d9-400c-bd7b-5c2f4ce25aa4 tempest-CinderUnicodeTest-282383181 None] Lock "cinder-quobyte-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:30:51 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a1942538-11d9-400c-bd7b-5c2f4ce25aa4 tempest-CinderUnicodeTest-282383181 None] Acquiring lock "cinder-quobyte-d0e80d7e-8f48-4418-960f-0ff9fbfdba5f" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:30:51 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a1942538-11d9-400c-bd7b-5c2f4ce25aa4 tempest-CinderUnicodeTest-282383181 None] Lock "cinder-quobyte-d0e80d7e-8f48-4418-960f-0ff9fbfdba5f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:30:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-a1942538-11d9-400c-bd7b-5c2f4ce25aa4 tempest-CinderUnicodeTest-282383181 None] Deleting offline snapshot d0e80d7e-8f48-4418-960f-0ff9fbfdba5f of volume b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:30:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-a1942538-11d9-400c-bd7b-5c2f4ce25aa4 tempest-CinderUnicodeTest-282383181 None] snapshot_file for this snap is: volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.d0e80d7e-8f48-4418-960f-0ff9fbfdba5f {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:30:51 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc637be-797e-4765-94b4-cea2d18ea763]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:30:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a1942538-11d9-400c-bd7b-5c2f4ce25aa4 tempest-CinderUnicodeTest-282383181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.d0e80d7e-8f48-4418-960f-0ff9fbfdba5f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:51 devstack sudo[105586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.d0e80d7e-8f48-4418-960f-0ff9fbfdba5f
Sep 16 16:30:51 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:51 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a1942538-11d9-400c-bd7b-5c2f4ce25aa4 tempest-CinderUnicodeTest-282383181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.d0e80d7e-8f48-4418-960f-0ff9fbfdba5f" returned: 0 in 0.399s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-a1942538-11d9-400c-bd7b-5c2f4ce25aa4 tempest-CinderUnicodeTest-282383181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:30:51 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a54cdc0-a512-43fd-9972-b73ea7f2974a]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:30:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a1942538-11d9-400c-bd7b-5c2f4ce25aa4 tempest-CinderUnicodeTest-282383181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:51 devstack sudo[105591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b
Sep 16 16:30:51 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:51 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a1942538-11d9-400c-bd7b-5c2f4ce25aa4 tempest-CinderUnicodeTest-282383181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b" returned: 0 in 0.407s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a1942538-11d9-400c-bd7b-5c2f4ce25aa4 tempest-CinderUnicodeTest-282383181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.d0e80d7e-8f48-4418-960f-0ff9fbfdba5f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:52 devstack sudo[105596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.d0e80d7e-8f48-4418-960f-0ff9fbfdba5f
Sep 16 16:30:52 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:52 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a1942538-11d9-400c-bd7b-5c2f4ce25aa4 tempest-CinderUnicodeTest-282383181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.d0e80d7e-8f48-4418-960f-0ff9fbfdba5f" returned: 0 in 0.393s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a1942538-11d9-400c-bd7b-5c2f4ce25aa4 tempest-CinderUnicodeTest-282383181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.d0e80d7e-8f48-4418-960f-0ff9fbfdba5f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:52 devstack sudo[105601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.d0e80d7e-8f48-4418-960f-0ff9fbfdba5f
Sep 16 16:30:52 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:52 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a1942538-11d9-400c-bd7b-5c2f4ce25aa4 tempest-CinderUnicodeTest-282383181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b.d0e80d7e-8f48-4418-960f-0ff9fbfdba5f" returned: 0 in 0.280s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:52 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a1942538-11d9-400c-bd7b-5c2f4ce25aa4 tempest-CinderUnicodeTest-282383181 None] Lock "cinder-quobyte-d0e80d7e-8f48-4418-960f-0ff9fbfdba5f" released by "_delete_snapshot" :: held 1.617s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:30:52 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a1942538-11d9-400c-bd7b-5c2f4ce25aa4 tempest-CinderUnicodeTest-282383181 None] Lock "cinder-quobyte-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b" released by "delete_snapshot" :: held 1.646s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:30:52 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-a1942538-11d9-400c-bd7b-5c2f4ce25aa4 tempest-CinderUnicodeTest-282383181 None] Created reservations ['d96fb8ef-09d1-4a33-a7e2-6db58e5ae221', 'aeada03e-4bb5-4485-bd3d-f8ea38fa29be', 'e25cdcf6-8758-4076-8199-7c89ece0a655', '774756f9-5a1f-499f-9006-6e41536c98f9'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:30:52 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-a1942538-11d9-400c-bd7b-5c2f4ce25aa4 tempest-CinderUnicodeTest-282383181 None] Delete snapshot completed successfully.
Sep 16 16:30:52 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a1942538-11d9-400c-bd7b-5c2f4ce25aa4 tempest-CinderUnicodeTest-282383181 None] Lock "cinder-d0e80d7e-8f48-4418-960f-0ff9fbfdba5f-delete_snapshot" released by "delete_snapshot" :: held 1.815s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:30:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7a04089b-cec2-4349-a493-ec51ebc2aa70 tempest-CinderUnicodeTest-282383181 None] Acquiring lock "cinder-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:30:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7a04089b-cec2-4349-a493-ec51ebc2aa70 tempest-CinderUnicodeTest-282383181 None] Lock "cinder-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:30:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7a04089b-cec2-4349-a493-ec51ebc2aa70 tempest-CinderUnicodeTest-282383181 None] Acquiring lock "cinder-quobyte-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:30:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7a04089b-cec2-4349-a493-ec51ebc2aa70 tempest-CinderUnicodeTest-282383181 None] Lock "cinder-quobyte-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b" acquired by "delete_volume" :: waited 0.023s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:30:53 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f2e7f1-387f-4443-9ecd-0eea67dec538]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:30:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7a04089b-cec2-4349-a493-ec51ebc2aa70 tempest-CinderUnicodeTest-282383181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:53 devstack sudo[105604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b
Sep 16 16:30:53 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:53 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7a04089b-cec2-4349-a493-ec51ebc2aa70 tempest-CinderUnicodeTest-282383181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b" returned: 0 in 0.398s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7a04089b-cec2-4349-a493-ec51ebc2aa70 tempest-CinderUnicodeTest-282383181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:53 devstack sudo[105609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b
Sep 16 16:30:53 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:54 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7a04089b-cec2-4349-a493-ec51ebc2aa70 tempest-CinderUnicodeTest-282383181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b" returned: 0 in 0.270s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7a04089b-cec2-4349-a493-ec51ebc2aa70 tempest-CinderUnicodeTest-282383181 None] Lock "cinder-quobyte-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b" released by "delete_volume" :: held 0.738s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:30:54 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-7a04089b-cec2-4349-a493-ec51ebc2aa70 tempest-CinderUnicodeTest-282383181 None] Created reservations ['3762a1db-4ed0-47f6-9f88-97cb2952744d', '40c1ba23-cd63-4fb7-91aa-0023a73b76f0', '2c6df5e9-79ff-4c14-a150-a7b0a896150c', '7233e8d2-98e2-46ab-b247-91a3f7982574'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:30:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7a04089b-cec2-4349-a493-ec51ebc2aa70 tempest-CinderUnicodeTest-282383181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:30:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7a04089b-cec2-4349-a493-ec51ebc2aa70 tempest-CinderUnicodeTest-282383181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:30:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7a04089b-cec2-4349-a493-ec51ebc2aa70 tempest-CinderUnicodeTest-282383181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:30:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7a04089b-cec2-4349-a493-ec51ebc2aa70 tempest-CinderUnicodeTest-282383181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:30:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7a04089b-cec2-4349-a493-ec51ebc2aa70 tempest-CinderUnicodeTest-282383181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:30:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7a04089b-cec2-4349-a493-ec51ebc2aa70 tempest-CinderUnicodeTest-282383181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:54 devstack sudo[105612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:30:54 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:54 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-70676bc3-ce02-49ac-9a60-399306f35445 tempest-CinderUnicodeTest-282383181 None] Acquiring lock "cinder-5301947f-e6b8-4676-9492-fd1e72ff2a3c-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:30:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7a04089b-cec2-4349-a493-ec51ebc2aa70 tempest-CinderUnicodeTest-282383181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.267s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:54 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-7a04089b-cec2-4349-a493-ec51ebc2aa70 tempest-CinderUnicodeTest-282383181 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:30:54 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-7a04089b-cec2-4349-a493-ec51ebc2aa70 tempest-CinderUnicodeTest-282383181 None] Deleted volume successfully.
Sep 16 16:30:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-70676bc3-ce02-49ac-9a60-399306f35445 tempest-CinderUnicodeTest-282383181 None] Lock "cinder-5301947f-e6b8-4676-9492-fd1e72ff2a3c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:30:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7a04089b-cec2-4349-a493-ec51ebc2aa70 tempest-CinderUnicodeTest-282383181 None] Lock "cinder-b2fcc8f4-1bb9-4eca-86d8-03eb3d844d0b-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:30:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-70676bc3-ce02-49ac-9a60-399306f35445 tempest-CinderUnicodeTest-282383181 None] Acquiring lock "cinder-quobyte-5301947f-e6b8-4676-9492-fd1e72ff2a3c" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:30:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-70676bc3-ce02-49ac-9a60-399306f35445 tempest-CinderUnicodeTest-282383181 None] Lock "cinder-quobyte-5301947f-e6b8-4676-9492-fd1e72ff2a3c" acquired by "delete_volume" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:30:54 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd4621d-05fe-4ab2-8aaf-8b4ac5751635]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:30:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-70676bc3-ce02-49ac-9a60-399306f35445 tempest-CinderUnicodeTest-282383181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5301947f-e6b8-4676-9492-fd1e72ff2a3c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:54 devstack sudo[105615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5301947f-e6b8-4676-9492-fd1e72ff2a3c
Sep 16 16:30:54 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:54 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-70676bc3-ce02-49ac-9a60-399306f35445 tempest-CinderUnicodeTest-282383181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5301947f-e6b8-4676-9492-fd1e72ff2a3c" returned: 0 in 0.375s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-70676bc3-ce02-49ac-9a60-399306f35445 tempest-CinderUnicodeTest-282383181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5301947f-e6b8-4676-9492-fd1e72ff2a3c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:54 devstack sudo[105620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5301947f-e6b8-4676-9492-fd1e72ff2a3c
Sep 16 16:30:54 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:55 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-70676bc3-ce02-49ac-9a60-399306f35445 tempest-CinderUnicodeTest-282383181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5301947f-e6b8-4676-9492-fd1e72ff2a3c" returned: 0 in 0.276s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-70676bc3-ce02-49ac-9a60-399306f35445 tempest-CinderUnicodeTest-282383181 None] Lock "cinder-quobyte-5301947f-e6b8-4676-9492-fd1e72ff2a3c" released by "delete_volume" :: held 0.695s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:30:55 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-70676bc3-ce02-49ac-9a60-399306f35445 tempest-CinderUnicodeTest-282383181 None] Created reservations ['a2830899-72be-4f73-ba4f-0c3f44040962', 'ad08d24b-6a31-4cc4-abe8-f53a88e7cae9', '58e48691-317c-4254-9820-7ec439aa6b3c', '5d11a066-5e28-4183-ae16-a031856f72d4'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:30:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-70676bc3-ce02-49ac-9a60-399306f35445 tempest-CinderUnicodeTest-282383181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:30:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-70676bc3-ce02-49ac-9a60-399306f35445 tempest-CinderUnicodeTest-282383181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:30:55 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-70676bc3-ce02-49ac-9a60-399306f35445 tempest-CinderUnicodeTest-282383181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:30:55 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-70676bc3-ce02-49ac-9a60-399306f35445 tempest-CinderUnicodeTest-282383181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:30:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-70676bc3-ce02-49ac-9a60-399306f35445 tempest-CinderUnicodeTest-282383181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:30:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-70676bc3-ce02-49ac-9a60-399306f35445 tempest-CinderUnicodeTest-282383181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:30:55 devstack sudo[105623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:30:55 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:30:55 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root
Sep 16 16:30:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-70676bc3-ce02-49ac-9a60-399306f35445 tempest-CinderUnicodeTest-282383181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.257s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:30:55 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-70676bc3-ce02-49ac-9a60-399306f35445 tempest-CinderUnicodeTest-282383181 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:30:55 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-70676bc3-ce02-49ac-9a60-399306f35445 tempest-CinderUnicodeTest-282383181 None] Deleted volume successfully.
Sep 16 16:30:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-70676bc3-ce02-49ac-9a60-399306f35445 tempest-CinderUnicodeTest-282383181 None] Lock "cinder-5301947f-e6b8-4676-9492-fd1e72ff2a3c-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:05 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=40,cinder:SELECT=31,cinder:INSERT=16,cinder:DELETE=4 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:31:05 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=42,cinder:UPDATE=44,cinder:INSERT=14,cinder:DELETE=3 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:31:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:31:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:07 devstack sudo[105702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:31:07 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:07 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.319s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:31:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:31:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 29 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:31:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>, <Thread(tpool_thread_0, started daemon 135438770624192)>, <Thread(tpool_thread_1, started daemon 135438762231488)>, <Thread(tpool_thread_2, started daemon 135438753838784)>, <Thread(tpool_thread_3, started daemon 135438745446080)>, <Thread(tpool_thread_4, started daemon 135438737053376)>, <Thread(tpool_thread_5, started daemon 135438728660672)>, <Thread(tpool_thread_6, started daemon 135438720267968)>, <Thread(tpool_thread_7, started daemon 135438711875264)>, <Thread(tpool_thread_8, started daemon 135438703466176)>, <Thread(tpool_thread_9, started daemon 135438695057088)>, <Thread(tpool_thread_10, started daemon 135438686648000)>, <Thread(tpool_thread_11, started daemon 135438678238912)>, <Thread(tpool_thread_12, started daemon 135438669829824)>, <Thread(tpool_thread_13, started daemon 135438661420736)>, <Thread(tpool_thread_14, started daemon 135438653011648)>, <Thread(tpool_thread_15, started daemon 135438644602560)>, <Thread(tpool_thread_16, started daemon 135438636193472)>, <Thread(tpool_thread_17, started daemon 135438627784384)>, <Thread(tpool_thread_18, started daemon 135438619375296)>, <Thread(tpool_thread_19, started daemon 135438610966208)>, <Thread(Rabbit-heartbeat, started daemon 135438772197760)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:31:08 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:31:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Flow 'volume_create_manager' (0d34d35b-ad07-483a-bb1e-e6c728b97df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d13992c3-a3f7-4c06-b8ec-adea208fc820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d13992c3-a3f7-4c06-b8ec-adea208fc820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1689978094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6988d6-8ae4-40f6-aff7-0246f04a7c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bbb985562954499bd6d6a691facf9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:08Z,use_quota=True,user_id='33776cd4d42a43ee8b0b9fb8e34d946c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06774730-0e68-44d6-8113-fd52587b5468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06774730-0e68-44d6-8113-fd52587b5468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e841a7d-6b0d-4362-a0ae-948e15041b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e841a7d-6b0d-4362-a0ae-948e15041b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc6988d6-8ae4-40f6-aff7-0246f04a7c00', 'volume_name': 'volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d932a08-1017-4e44-b83d-3162e5a612b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d932a08-1017-4e44-b83d-3162e5a612b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9060471b-8fda-4005-b247-2b1ac561d3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:08 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Volume bc6988d6-8ae4-40f6-aff7-0246f04a7c00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00', 'volume_size': 1}
Sep 16 16:31:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1689978094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6988d6-8ae4-40f6-aff7-0246f04a7c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bbb985562954499bd6d6a691facf9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:08Z,use_quota=True,user_id='33776cd4d42a43ee8b0b9fb8e34d946c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:31:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Creating volume bc6988d6-8ae4-40f6-aff7-0246f04a7c00 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:31:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:31:08 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:31:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:08 devstack sudo[105705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00 1073741824
Sep 16 16:31:08 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:09 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00 1073741824" returned: 0 in 0.717s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:09 devstack sudo[105711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00
Sep 16 16:31:09 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Flow 'volume_create_manager' (45e2c7be-0447-4e17-9e5a-5eaf51a129d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65679450-b5f3-41dc-91cd-bb618425e5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65679450-b5f3-41dc-91cd-bb618425e5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-329219700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762e20b1-48b2-4d4e-a8ab-2fd24c016019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23040878bf9840df98e79bd365e9fbd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:09Z,use_quota=True,user_id='a7b6b354f2784809adcab7bd5c3a4dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca34c25-f09f-490e-8400-8f7800ebb944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca34c25-f09f-490e-8400-8f7800ebb944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f67dfa-5561-4ad7-8aed-d11b53cda559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f67dfa-5561-4ad7-8aed-d11b53cda559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '762e20b1-48b2-4d4e-a8ab-2fd24c016019', 'volume_name': 'volume-762e20b1-48b2-4d4e-a8ab-2fd24c016019', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1afb1c57-b795-48d7-8618-9cde6c3a0a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1afb1c57-b795-48d7-8618-9cde6c3a0a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f894c0e6-45a2-4aef-a6aa-591151aa66fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:09 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Volume 762e20b1-48b2-4d4e-a8ab-2fd24c016019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-762e20b1-48b2-4d4e-a8ab-2fd24c016019', 'volume_size': 1}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Flow 'volume_create_manager' (3bda560b-aea4-4da9-af6c-63882489b24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c719cc2-9d7c-4aa4-b98b-4617c1f12a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c719cc2-9d7c-4aa4-b98b-4617c1f12a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-475623515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=926b59b4-fb4b-41f8-a483-82b2c7998b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c029323bed0d47b2baa54a09734b58ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:10Z,use_quota=True,user_id='f15692f6ab1842da892fcc10039b6cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:09 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8499d4-7383-47e6-b07d-2837acc5db03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8499d4-7383-47e6-b07d-2837acc5db03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a21272c-b917-4753-8d85-da41b0127408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a21272c-b917-4753-8d85-da41b0127408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '926b59b4-fb4b-41f8-a483-82b2c7998b54', 'volume_name': 'volume-926b59b4-fb4b-41f8-a483-82b2c7998b54', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b1e3969-47ce-47d6-8f63-8ff06f16f10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b1e3969-47ce-47d6-8f63-8ff06f16f10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e681d78-f723-4688-88c1-5e57e7512488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:09 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Volume 926b59b4-fb4b-41f8-a483-82b2c7998b54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-926b59b4-fb4b-41f8-a483-82b2c7998b54', 'volume_size': 1}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00" returned: 0 in 0.454s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.245s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-329219700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762e20b1-48b2-4d4e-a8ab-2fd24c016019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23040878bf9840df98e79bd365e9fbd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:09Z,use_quota=True,user_id='a7b6b354f2784809adcab7bd5c3a4dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Creating volume 762e20b1-48b2-4d4e-a8ab-2fd24c016019 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:31:09 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-762e20b1-48b2-4d4e-a8ab-2fd24c016019 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:09 devstack sudo[105714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-762e20b1-48b2-4d4e-a8ab-2fd24c016019 1073741824
Sep 16 16:31:09 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9060471b-8fda-4005-b247-2b1ac561d3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31914cb9-e926-45bd-b288-1d5505982c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:09 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Volume volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00 (bc6988d6-8ae4-40f6-aff7-0246f04a7c00): created successfully
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31914cb9-e926-45bd-b288-1d5505982c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Flow 'volume_create_manager' (0d34d35b-ad07-483a-bb1e-e6c728b97df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Flow 'volume_create_manager' (d1b8a08b-06d5-4888-8a02-0ee32be65041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8308072f-3a9c-421a-a2db-9d45e2d8a514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8308072f-3a9c-421a-a2db-9d45e2d8a514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-558870981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=148fe60e-fa03-4212-afd9-dc51b5dcb496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23040878bf9840df98e79bd365e9fbd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:10Z,use_quota=True,user_id='a7b6b354f2784809adcab7bd5c3a4dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0278e720-871b-45be-a111-ae407f85f33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0278e720-871b-45be-a111-ae407f85f33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5bd891-49cf-4776-ba0a-b67fc4e0ad28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5bd891-49cf-4776-ba0a-b67fc4e0ad28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '148fe60e-fa03-4212-afd9-dc51b5dcb496', 'volume_name': 'volume-148fe60e-fa03-4212-afd9-dc51b5dcb496', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede16b31-ff07-43e2-809a-b51b34e998eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede16b31-ff07-43e2-809a-b51b34e998eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75c7eb3-2afe-4536-8b57-f6dfb06fc911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:10 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Volume 148fe60e-fa03-4212-afd9-dc51b5dcb496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-148fe60e-fa03-4212-afd9-dc51b5dcb496', 'volume_size': 1}
Sep 16 16:31:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:10 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-86c028fc-f43a-4aa3-86d6-5816ed9b505d tempest-CreateVolumesFromSnapshotTest-993043390 None] Created volume successfully.
Sep 16 16:31:10 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:31:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Flow 'volume_create_manager' (ce231ec5-90a7-46db-9608-cfe021569f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1384ebc1-8809-45ac-9756-d9ba553e5207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1384ebc1-8809-45ac-9756-d9ba553e5207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-353628090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ca607a0-d901-4efb-a8df-db41a4a40c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23040878bf9840df98e79bd365e9fbd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:10Z,use_quota=True,user_id='a7b6b354f2784809adcab7bd5c3a4dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acca94a1-2d6d-48c3-8d6c-e5528a1d18e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acca94a1-2d6d-48c3-8d6c-e5528a1d18e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d2f580-4260-4154-9c24-1dd07ab7fc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d2f580-4260-4154-9c24-1dd07ab7fc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ca607a0-d901-4efb-a8df-db41a4a40c69', 'volume_name': 'volume-4ca607a0-d901-4efb-a8df-db41a4a40c69', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a15a0e-d4fe-44fe-8c44-9314785ea3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a15a0e-d4fe-44fe-8c44-9314785ea3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ba4af74-9896-42dd-8ff9-0228de18914b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:10 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Volume 4ca607a0-d901-4efb-a8df-db41a4a40c69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ca607a0-d901-4efb-a8df-db41a4a40c69', 'volume_size': 1}
Sep 16 16:31:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:10 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-762e20b1-48b2-4d4e-a8ab-2fd24c016019 1073741824" returned: 0 in 0.753s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-762e20b1-48b2-4d4e-a8ab-2fd24c016019 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:10 devstack sudo[105720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-762e20b1-48b2-4d4e-a8ab-2fd24c016019
Sep 16 16:31:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9f160b2b-eb78-482e-b6c0-f135c214efc0 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:10 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:10 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:31:10 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Flow 'volume_create_manager' (fb3a2d4c-7274-4ef8-b14b-eeb54f40561e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38273768-0a3c-47d6-9143-b824dc195773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-762e20b1-48b2-4d4e-a8ab-2fd24c016019" returned: 0 in 0.398s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.244s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-475623515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=926b59b4-fb4b-41f8-a483-82b2c7998b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c029323bed0d47b2baa54a09734b58ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:10Z,use_quota=True,user_id='f15692f6ab1842da892fcc10039b6cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Creating volume 926b59b4-fb4b-41f8-a483-82b2c7998b54 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:31:11 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-926b59b4-fb4b-41f8-a483-82b2c7998b54 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38273768-0a3c-47d6-9143-b824dc195773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1908116189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23040878bf9840df98e79bd365e9fbd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:11Z,use_quota=True,user_id='a7b6b354f2784809adcab7bd5c3a4dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:11 devstack sudo[105724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-926b59b4-fb4b-41f8-a483-82b2c7998b54 1073741824
Sep 16 16:31:11 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f839123f-8bd2-4efd-a510-93f17fb4357c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f839123f-8bd2-4efd-a510-93f17fb4357c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87165d3a-6783-45be-baff-188bbd64f595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87165d3a-6783-45be-baff-188bbd64f595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c', 'volume_name': 'volume-fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d6974b-2b33-4e1f-bc57-ee720c24e028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d6974b-2b33-4e1f-bc57-ee720c24e028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6d4a3e-3877-4145-97c6-ee9c9ec955b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:11 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Volume fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c', 'volume_size': 1}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f894c0e6-45a2-4aef-a6aa-591151aa66fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-762e20b1-48b2-4d4e-a8ab-2fd24c016019', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0186b742-3df9-4ab0-892a-3371bb6447ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:11 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Volume volume-762e20b1-48b2-4d4e-a8ab-2fd24c016019 (762e20b1-48b2-4d4e-a8ab-2fd24c016019): created successfully
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0186b742-3df9-4ab0-892a-3371bb6447ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Flow 'volume_create_manager' (45e2c7be-0447-4e17-9e5a-5eaf51a129d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:11 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-8234b04d-9c0e-4537-9d60-80abcec55a11 tempest-CreateVolumesFromImageTest-269734144 None] Created volume successfully.
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Flow 'volume_create_manager' (ea33020d-3eac-4d89-baa0-4514ceb3c2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ab69ab-6758-4a15-9515-61c062368d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ab69ab-6758-4a15-9515-61c062368d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1361855803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a5ef46-034a-42bd-b029-f99a4c94acb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23040878bf9840df98e79bd365e9fbd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:11Z,use_quota=True,user_id='a7b6b354f2784809adcab7bd5c3a4dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124eafcf-e477-47a3-95e4-d604116135b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124eafcf-e477-47a3-95e4-d604116135b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea7ea38-1e7c-46a4-b5c6-6405c8405d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea7ea38-1e7c-46a4-b5c6-6405c8405d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83a5ef46-034a-42bd-b029-f99a4c94acb7', 'volume_name': 'volume-83a5ef46-034a-42bd-b029-f99a4c94acb7', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c48680e-555d-4ef1-86cd-d1f450b9bc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c48680e-555d-4ef1-86cd-d1f450b9bc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d98c6f-d3d7-4a8c-a2fd-bf585a3f4302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:11 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Volume 83a5ef46-034a-42bd-b029-f99a4c94acb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83a5ef46-034a-42bd-b029-f99a4c94acb7', 'volume_size': 1}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:11 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-926b59b4-fb4b-41f8-a483-82b2c7998b54 1073741824" returned: 0 in 0.583s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-926b59b4-fb4b-41f8-a483-82b2c7998b54 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:11 devstack sudo[105730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-926b59b4-fb4b-41f8-a483-82b2c7998b54
Sep 16 16:31:11 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:11 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-926b59b4-fb4b-41f8-a483-82b2c7998b54" returned: 0 in 0.311s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.990s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-558870981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=148fe60e-fa03-4212-afd9-dc51b5dcb496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23040878bf9840df98e79bd365e9fbd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:10Z,use_quota=True,user_id='a7b6b354f2784809adcab7bd5c3a4dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Creating volume 148fe60e-fa03-4212-afd9-dc51b5dcb496 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:31:12 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-148fe60e-fa03-4212-afd9-dc51b5dcb496 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e681d78-f723-4688-88c1-5e57e7512488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-926b59b4-fb4b-41f8-a483-82b2c7998b54', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e33d6f-45ff-419f-8092-ff72db68d114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:12 devstack sudo[105733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-148fe60e-fa03-4212-afd9-dc51b5dcb496 1073741824
Sep 16 16:31:12 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:12 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Volume volume-926b59b4-fb4b-41f8-a483-82b2c7998b54 (926b59b4-fb4b-41f8-a483-82b2c7998b54): created successfully
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e33d6f-45ff-419f-8092-ff72db68d114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Flow 'volume_create_manager' (3bda560b-aea4-4da9-af6c-63882489b24d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:12 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-e55ff667-4bc8-454c-8731-6b34d2b304a7 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Created volume successfully.
Sep 16 16:31:12 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-148fe60e-fa03-4212-afd9-dc51b5dcb496 1073741824" returned: 0 in 0.592s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-148fe60e-fa03-4212-afd9-dc51b5dcb496 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:12 devstack sudo[105738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-148fe60e-fa03-4212-afd9-dc51b5dcb496
Sep 16 16:31:12 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:12 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-148fe60e-fa03-4212-afd9-dc51b5dcb496" returned: 0 in 0.333s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.493s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-353628090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ca607a0-d901-4efb-a8df-db41a4a40c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23040878bf9840df98e79bd365e9fbd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:10Z,use_quota=True,user_id='a7b6b354f2784809adcab7bd5c3a4dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Creating volume 4ca607a0-d901-4efb-a8df-db41a4a40c69 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:31:12 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:31:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4ca607a0-d901-4efb-a8df-db41a4a40c69 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75c7eb3-2afe-4536-8b57-f6dfb06fc911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-148fe60e-fa03-4212-afd9-dc51b5dcb496', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef4cd27-7e41-43de-9992-62a0159eec86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:13 devstack sudo[105741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4ca607a0-d901-4efb-a8df-db41a4a40c69 1073741824
Sep 16 16:31:13 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:13 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Volume volume-148fe60e-fa03-4212-afd9-dc51b5dcb496 (148fe60e-fa03-4212-afd9-dc51b5dcb496): created successfully
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef4cd27-7e41-43de-9992-62a0159eec86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Flow 'volume_create_manager' (d1b8a08b-06d5-4888-8a02-0ee32be65041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:13 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-0f8a8287-3ffb-4769-a84d-edbb74836705 tempest-CreateVolumesFromImageTest-269734144 None] Created volume successfully.
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Flow 'volume_create_manager' (ecbd7edf-86f2-41f0-97da-60e258915d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e3075d5-85d9-4b71-98fe-0fbdf282db59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e3075d5-85d9-4b71-98fe-0fbdf282db59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1384694752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c570e19d-1c62-4488-a22a-8dce9dbabe96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c029323bed0d47b2baa54a09734b58ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:13Z,use_quota=True,user_id='f15692f6ab1842da892fcc10039b6cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764cae37-7716-48bc-b1bc-666fab7f2311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764cae37-7716-48bc-b1bc-666fab7f2311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d100cb0-370f-4920-b5fc-586abb7b1ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d100cb0-370f-4920-b5fc-586abb7b1ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c570e19d-1c62-4488-a22a-8dce9dbabe96', 'volume_name': 'volume-c570e19d-1c62-4488-a22a-8dce9dbabe96', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251b5ae3-35c5-4fdf-8952-6f72d4e8c1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251b5ae3-35c5-4fdf-8952-6f72d4e8c1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b08d33-d6f8-424f-a38e-c45dcdca72b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:13 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Volume c570e19d-1c62-4488-a22a-8dce9dbabe96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c570e19d-1c62-4488-a22a-8dce9dbabe96', 'volume_size': 1}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Flow 'volume_create_manager' (4ac2ca63-71c4-40c7-9850-9ea6f93e3dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90c2b9cc-2200-4233-811b-1e3098354039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90c2b9cc-2200-4233-811b-1e3098354039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2002373852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5287526-8e68-450d-b6ce-eb748fa5f11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c029323bed0d47b2baa54a09734b58ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:13Z,use_quota=True,user_id='f15692f6ab1842da892fcc10039b6cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1914befa-283c-4540-a9a2-ba01de47bab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1914befa-283c-4540-a9a2-ba01de47bab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d52729-3f73-4f58-a7dd-a44e72c985fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d52729-3f73-4f58-a7dd-a44e72c985fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5287526-8e68-450d-b6ce-eb748fa5f11f', 'volume_name': 'volume-e5287526-8e68-450d-b6ce-eb748fa5f11f', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9abfe35b-d160-43f9-8f09-e940a4907f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9abfe35b-d160-43f9-8f09-e940a4907f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3381b413-130c-4b2e-8420-2f2d6b6d2baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:13 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Volume e5287526-8e68-450d-b6ce-eb748fa5f11f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5287526-8e68-450d-b6ce-eb748fa5f11f', 'volume_size': 1}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:13 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4ca607a0-d901-4efb-a8df-db41a4a40c69 1073741824" returned: 0 in 0.664s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4ca607a0-d901-4efb-a8df-db41a4a40c69 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:13 devstack sudo[105753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4ca607a0-d901-4efb-a8df-db41a4a40c69
Sep 16 16:31:13 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:13 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Flow 'volume_create_manager' (3189d197-4068-484f-851b-c599eb0402a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7943b813-6f66-4cfb-b1da-b1b3443ab42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:14 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7943b813-6f66-4cfb-b1da-b1b3443ab42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7ad68d-32d2-4128-bcb8-d4afeff84b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe6399a952d46a8943cde67e0dbaa36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:14Z,use_quota=True,user_id='b853a898cebc49f5a5d11235926352ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d72b191-4c39-404b-92bd-0b4ec8a1626d),volume_type_id=9d72b191-4c39-404b-92bd-0b4ec8a1626d)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb30e23-26b6-4aa7-a58f-7b0949e03dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb30e23-26b6-4aa7-a58f-7b0949e03dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32550be2-7f49-4ec7-bcc1-58dcacbaad77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.image.glance [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Creating Keystone auth plugin from conf {{(pid=86165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4ca607a0-d901-4efb-a8df-db41a4a40c69" returned: 0 in 0.348s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9f160b2b-eb78-482e-b6c0-f135c214efc0 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.414s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Flow 'volume_create_manager' (61261951-74cc-406e-9018-7a2218cafb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3336d7be-36d1-413c-8bd9-58a166d96964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ba4af74-9896-42dd-8ff9-0228de18914b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ca607a0-d901-4efb-a8df-db41a4a40c69', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d71cc21-4a8f-40b0-9811-d74d00a5b531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3336d7be-36d1-413c-8bd9-58a166d96964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2041862463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609f7854-1616-4b45-a7bd-e2b86f3cf68c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c029323bed0d47b2baa54a09734b58ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:14Z,use_quota=True,user_id='f15692f6ab1842da892fcc10039b6cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7111ac3e-7c1c-4599-b18e-44b9e0b32ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7111ac3e-7c1c-4599-b18e-44b9e0b32ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4fab50-38e1-412b-8c20-26c0b849562a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4fab50-38e1-412b-8c20-26c0b849562a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '609f7854-1616-4b45-a7bd-e2b86f3cf68c', 'volume_name': 'volume-609f7854-1616-4b45-a7bd-e2b86f3cf68c', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1fd16dd-8b21-4498-9c11-02571ed0f58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1fd16dd-8b21-4498-9c11-02571ed0f58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed9bda8-1a1e-4ce7-9164-8d3f907c24e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:14 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Volume 609f7854-1616-4b45-a7bd-e2b86f3cf68c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-609f7854-1616-4b45-a7bd-e2b86f3cf68c', 'volume_size': 1}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-9f160b2b-eb78-482e-b6c0-f135c214efc0 tempest-CreateVolumesFromSnapshotTest-993043390 None] Creating offline snapshot ffdc6816-ad52-4afb-9ebd-3b95163bf73f of volume bc6988d6-8ae4-40f6-aff7-0246f04a7c00 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:31:14 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Volume volume-4ca607a0-d901-4efb-a8df-db41a4a40c69 (4ca607a0-d901-4efb-a8df-db41a4a40c69): created successfully
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d71cc21-4a8f-40b0-9811-d74d00a5b531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Flow 'volume_create_manager' (ce231ec5-90a7-46db-9608-cfe021569f2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[92903add-5407-46f8-a716-1320c8434c35]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9f160b2b-eb78-482e-b6c0-f135c214efc0 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:14 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-9aa9e73a-6e38-469a-8713-4b31e867a345 tempest-CreateVolumesFromImageTest-269734144 None] Created volume successfully.
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Flow 'volume_create_manager' (b4ed8ffe-f7db-4265-b6ae-64ee397695e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:14 devstack sudo[105756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00
Sep 16 16:31:14 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb7134b-867f-4381-a6ce-82744a5f0236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb7134b-867f-4381-a6ce-82744a5f0236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2117358998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e010b2e-ec3b-4b9f-a4ea-8005eca282c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c029323bed0d47b2baa54a09734b58ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:14Z,use_quota=True,user_id='f15692f6ab1842da892fcc10039b6cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1748df69-080a-4d26-a7a6-b3899a314a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1748df69-080a-4d26-a7a6-b3899a314a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (167a6dc8-5c41-4cf5-8026-87d77ff8a39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (167a6dc8-5c41-4cf5-8026-87d77ff8a39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e010b2e-ec3b-4b9f-a4ea-8005eca282c5', 'volume_name': 'volume-0e010b2e-ec3b-4b9f-a4ea-8005eca282c5', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (354a2e2d-9bbe-4f10-a3ec-2ebc4bcad5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (354a2e2d-9bbe-4f10-a3ec-2ebc4bcad5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ef5ced-8106-497c-aa81-9562c449a1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:14 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Volume 0e010b2e-ec3b-4b9f-a4ea-8005eca282c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e010b2e-ec3b-4b9f-a4ea-8005eca282c5', 'volume_size': 1}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32550be2-7f49-4ec7-bcc1-58dcacbaad77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2a7ad68d-32d2-4128-bcb8-d4afeff84b0f', 'volume_name': 'volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f', 'volume_size': 1, 'image_id': 'b799d573-9607-4723-8e96-df0605e981fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b799d573-9607-4723-8e96-df0605e981fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7cea0e22a5b89bf710e139dbf22e1e1e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5fe6399a952d46a8943cde67e0dbaa36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ead9aa50c2008da02d128f2e4c865ab7dfb5742a2f53636c6ff0a0c7644bd5a76400a9c29c6e60b4a8ed87b02e1aa88f03f7bedfc042ae7e48dc4747285873f', 'id': 'b799d573-9607-4723-8e96-df0605e981fe', 'created_at': datetime.datetime(2026, 9, 16, 14, 31, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 31, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b799d573-9607-4723-8e96-df0605e981fe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e4c206510>}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206afecb-6044-4f5d-96d6-10e5d54bbf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206afecb-6044-4f5d-96d6-10e5d54bbf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2799115b-54ca-4b8c-bbab-d21665c52939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:14 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Volume 2a7ad68d-32d2-4128-bcb8-d4afeff84b0f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f', 'volume_size': 1, 'image_id': 'b799d573-9607-4723-8e96-df0605e981fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b799d573-9607-4723-8e96-df0605e981fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7cea0e22a5b89bf710e139dbf22e1e1e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5fe6399a952d46a8943cde67e0dbaa36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ead9aa50c2008da02d128f2e4c865ab7dfb5742a2f53636c6ff0a0c7644bd5a76400a9c29c6e60b4a8ed87b02e1aa88f03f7bedfc042ae7e48dc4747285873f', 'id': 'b799d573-9607-4723-8e96-df0605e981fe', 'created_at': datetime.datetime(2026, 9, 16, 14, 31, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 31, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b799d573-9607-4723-8e96-df0605e981fe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e4c206510>}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Trying to clone 2a7ad68d-32d2-4128-bcb8-d4afeff84b0f from image b799d573-9607-4723-8e96-df0605e981fe at location (None, [{'url': 'file:///opt/stack/data/glance/images/b799d573-9607-4723-8e96-df0605e981fe', 'metadata': {}}]). {{(pid=86165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 16:31:14 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Image download 0.00 MB at 0.00 MB/s
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d092bfe-778b-45dc-aea7-fbb0ea6ecff6]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:14 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9f160b2b-eb78-482e-b6c0-f135c214efc0 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00" returned: 0 in 0.554s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9f160b2b-eb78-482e-b6c0-f135c214efc0 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.ffdc6816-ad52-4afb-9ebd-3b95163bf73f 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:31:14 devstack sudo[105761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD
Sep 16 16:31:14 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:14 devstack sudo[105762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.ffdc6816-ad52-4afb-9ebd-3b95163bf73f 1G
Sep 16 16:31:14 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Flow 'volume_create_manager' (d16da7f7-55bf-4713-b99f-d9f2336e1522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f90101-b1f3-4ae0-bdee-56ddd775b341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f90101-b1f3-4ae0-bdee-56ddd775b341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1138720641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba66244-1783-4c0d-9736-820a213559a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c029323bed0d47b2baa54a09734b58ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:15Z,use_quota=True,user_id='f15692f6ab1842da892fcc10039b6cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d515a05e-c460-402a-bdc4-8244b9986cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d515a05e-c460-402a-bdc4-8244b9986cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d429cd-a48a-4d47-be60-282b6e9b184f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d429cd-a48a-4d47-be60-282b6e9b184f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ba66244-1783-4c0d-9736-820a213559a2', 'volume_name': 'volume-6ba66244-1783-4c0d-9736-820a213559a2', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29261f9c-9d34-4f13-a407-cc03f9b287c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29261f9c-9d34-4f13-a407-cc03f9b287c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a868b44-806e-4a0f-8a7f-981ae55aa1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:14 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Volume 6ba66244-1783-4c0d-9736-820a213559a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ba66244-1783-4c0d-9736-820a213559a2', 'volume_size': 1}
Sep 16 16:31:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:15 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:15 devstack sudo[105769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD
Sep 16 16:31:15 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:15 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9f160b2b-eb78-482e-b6c0-f135c214efc0 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.ffdc6816-ad52-4afb-9ebd-3b95163bf73f 1G" returned: 0 in 0.456s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9f160b2b-eb78-482e-b6c0-f135c214efc0 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.ffdc6816-ad52-4afb-9ebd-3b95163bf73f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:15 devstack sudo[105772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.ffdc6816-ad52-4afb-9ebd-3b95163bf73f
Sep 16 16:31:15 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:15 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD" returned: 1 in 0.321s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:31:15 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Temporary image b799d573-9607-4723-8e96-df0605e981fe is fetched for user b853a898cebc49f5a5d11235926352ad. {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 16:31:15 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49f5e95-455f-4092-bda5-2544cde5a683]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:15 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:15 devstack sudo[105777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD
Sep 16 16:31:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9f160b2b-eb78-482e-b6c0-f135c214efc0 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.ffdc6816-ad52-4afb-9ebd-3b95163bf73f" returned: 0 in 0.298s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:15 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-9f160b2b-eb78-482e-b6c0-f135c214efc0 tempest-CreateVolumesFromSnapshotTest-993043390 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.ffdc6816-ad52-4afb-9ebd-3b95163bf73f is being set with open permissions: ugo+rw
Sep 16 16:31:15 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9f160b2b-eb78-482e-b6c0-f135c214efc0 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.ffdc6816-ad52-4afb-9ebd-3b95163bf73f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:15 devstack sudo[105782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.ffdc6816-ad52-4afb-9ebd-3b95163bf73f
Sep 16 16:31:15 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:15 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:15 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9f160b2b-eb78-482e-b6c0-f135c214efc0 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.ffdc6816-ad52-4afb-9ebd-3b95163bf73f" returned: 0 in 0.260s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9f160b2b-eb78-482e-b6c0-f135c214efc0 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:15 devstack sudo[105788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.info
Sep 16 16:31:15 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:15 devstack sudo[105787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD
Sep 16 16:31:15 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:16 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:31:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:16 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9f160b2b-eb78-482e-b6c0-f135c214efc0 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.info" returned: 0 in 0.271s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:16 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-9f160b2b-eb78-482e-b6c0-f135c214efc0 tempest-CreateVolumesFromSnapshotTest-993043390 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.info is being set with open permissions: ugo+rw
Sep 16 16:31:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9f160b2b-eb78-482e-b6c0-f135c214efc0 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:16 devstack sudo[105795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.info
Sep 16 16:31:16 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:16 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9f160b2b-eb78-482e-b6c0-f135c214efc0 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.info" returned: 0 in 0.237s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9f160b2b-eb78-482e-b6c0-f135c214efc0 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.308s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.238s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1908116189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23040878bf9840df98e79bd365e9fbd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:11Z,use_quota=True,user_id='a7b6b354f2784809adcab7bd5c3a4dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:31:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Creating volume fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:31:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:31:16 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:31:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:16 devstack sudo[105798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c 1073741824
Sep 16 16:31:16 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:16 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-9f160b2b-eb78-482e-b6c0-f135c214efc0 tempest-CreateVolumesFromSnapshotTest-993043390 None] Create snapshot completed successfully
Sep 16 16:31:16 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c 1073741824" returned: 0 in 0.448s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:16 devstack sudo[105803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c
Sep 16 16:31:16 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:17 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c" returned: 0 in 0.286s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.684s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1361855803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83a5ef46-034a-42bd-b029-f99a4c94acb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23040878bf9840df98e79bd365e9fbd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:11Z,use_quota=True,user_id='a7b6b354f2784809adcab7bd5c3a4dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Creating volume 83a5ef46-034a-42bd-b029-f99a4c94acb7 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:31:17 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-83a5ef46-034a-42bd-b029-f99a4c94acb7 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6d4a3e-3877-4145-97c6-ee9c9ec955b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1ffd99-d31f-434b-82fd-85dd85add69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:17 devstack sudo[105806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-83a5ef46-034a-42bd-b029-f99a4c94acb7 1073741824
Sep 16 16:31:17 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:17 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Volume volume-fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c (fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c): created successfully
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1ffd99-d31f-434b-82fd-85dd85add69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Flow 'volume_create_manager' (fb3a2d4c-7274-4ef8-b14b-eeb54f40561e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:17 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-22aede31-1ecd-4d4c-8ec7-741093f5a4bf tempest-CreateVolumesFromImageTest-269734144 None] Created volume successfully.
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Flow 'volume_create_manager' (3641b5f8-e8e3-4eb2-a59a-f3be86c18bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60cda06-3c6c-4c33-8128-420bb8d29e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60cda06-3c6c-4c33-8128-420bb8d29e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-37325084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea78372-0e08-4330-9cdb-ac8cbf5676a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bbb985562954499bd6d6a691facf9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:17Z,use_quota=True,user_id='33776cd4d42a43ee8b0b9fb8e34d946c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4eaa4a2-a7f2-4134-8e52-cb5e4ad9edd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4eaa4a2-a7f2-4134-8e52-cb5e4ad9edd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86abbbe6-5c39-4055-aff0-8e203f9503a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86abbbe6-5c39-4055-aff0-8e203f9503a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fea78372-0e08-4330-9cdb-ac8cbf5676a2', 'volume_name': 'volume-fea78372-0e08-4330-9cdb-ac8cbf5676a2', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b88766-94d4-4efa-922c-753407adeff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b88766-94d4-4efa-922c-753407adeff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9316aaca-bdfd-4199-a5e4-db1078f83f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:17 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Volume fea78372-0e08-4330-9cdb-ac8cbf5676a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fea78372-0e08-4330-9cdb-ac8cbf5676a2', 'volume_size': 1}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:17 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-83a5ef46-034a-42bd-b029-f99a4c94acb7 1073741824" returned: 0 in 0.529s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-83a5ef46-034a-42bd-b029-f99a4c94acb7 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:17 devstack sudo[105812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-83a5ef46-034a-42bd-b029-f99a4c94acb7
Sep 16 16:31:17 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:31:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Flow 'volume_create_manager' (c3bdab0e-ea38-4681-baaa-632040438c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0e0d21-ef66-418a-b65d-b04d84eccf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0e0d21-ef66-418a-b65d-b04d84eccf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1700110274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3775f27d-53f0-4c2d-9e0a-409a8802b974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bbb985562954499bd6d6a691facf9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:18Z,use_quota=True,user_id='33776cd4d42a43ee8b0b9fb8e34d946c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a36a32-27e0-40d3-ace9-874ccdce56d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a36a32-27e0-40d3-ace9-874ccdce56d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3852ca9c-04ee-4209-961a-ca4983afb10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3852ca9c-04ee-4209-961a-ca4983afb10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3775f27d-53f0-4c2d-9e0a-409a8802b974', 'volume_name': 'volume-3775f27d-53f0-4c2d-9e0a-409a8802b974', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeab4039-3998-4759-9189-e6fb6176e01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeab4039-3998-4759-9189-e6fb6176e01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a85d57-bf22-42d5-947c-471c13e381bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:18 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Volume 3775f27d-53f0-4c2d-9e0a-409a8802b974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3775f27d-53f0-4c2d-9e0a-409a8802b974', 'volume_size': 1}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:18 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-83a5ef46-034a-42bd-b029-f99a4c94acb7" returned: 0 in 0.352s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.881s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1384694752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c570e19d-1c62-4488-a22a-8dce9dbabe96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c029323bed0d47b2baa54a09734b58ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:13Z,use_quota=True,user_id='f15692f6ab1842da892fcc10039b6cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Creating volume c570e19d-1c62-4488-a22a-8dce9dbabe96 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:31:18 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c570e19d-1c62-4488-a22a-8dce9dbabe96 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d98c6f-d3d7-4a8c-a2fd-bf585a3f4302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83a5ef46-034a-42bd-b029-f99a4c94acb7', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:18 devstack sudo[105815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c570e19d-1c62-4488-a22a-8dce9dbabe96 1073741824
Sep 16 16:31:18 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31328ad7-87e4-4595-a537-3082f8fc67ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:18 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Volume volume-83a5ef46-034a-42bd-b029-f99a4c94acb7 (83a5ef46-034a-42bd-b029-f99a4c94acb7): created successfully
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31328ad7-87e4-4595-a537-3082f8fc67ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Flow 'volume_create_manager' (ea33020d-3eac-4d89-baa0-4514ceb3c2c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:18 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-1f400f4a-4da1-4738-9d4d-58eb29c52e4e tempest-CreateVolumesFromImageTest-269734144 None] Created volume successfully.
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4062a1d5-4285-4402-a348-345e736024ea tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "cinder-83a5ef46-034a-42bd-b029-f99a4c94acb7-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4062a1d5-4285-4402-a348-345e736024ea tempest-CreateVolumesFromImageTest-269734144 None] Lock "cinder-83a5ef46-034a-42bd-b029-f99a4c94acb7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4062a1d5-4285-4402-a348-345e736024ea tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "cinder-quobyte-83a5ef46-034a-42bd-b029-f99a4c94acb7" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4062a1d5-4285-4402-a348-345e736024ea tempest-CreateVolumesFromImageTest-269734144 None] Lock "cinder-quobyte-83a5ef46-034a-42bd-b029-f99a4c94acb7" acquired by "delete_volume" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Flow 'volume_create_manager' (6284bb79-1df6-4757-80d6-adfb974faa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77dee235-79c3-42c4-816f-b2edaa9eb7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[85de02d7-9672-49aa-9113-80a10bc44e10]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4062a1d5-4285-4402-a348-345e736024ea tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-83a5ef46-034a-42bd-b029-f99a4c94acb7 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77dee235-79c3-42c4-816f-b2edaa9eb7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1345664111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=430b5b14-1d9e-461f-b844-66f4042de870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bbb985562954499bd6d6a691facf9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:18Z,use_quota=True,user_id='33776cd4d42a43ee8b0b9fb8e34d946c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f542e8-f667-4890-90f6-fd999edb08b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f542e8-f667-4890-90f6-fd999edb08b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49c11c6-b3fb-4045-935d-dbcc26534d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49c11c6-b3fb-4045-935d-dbcc26534d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '430b5b14-1d9e-461f-b844-66f4042de870', 'volume_name': 'volume-430b5b14-1d9e-461f-b844-66f4042de870', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (235f10cb-8e9c-4d05-b1b7-0336473382f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (235f10cb-8e9c-4d05-b1b7-0336473382f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416f69ce-3667-4b83-94b2-86c919090a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:18 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Volume 430b5b14-1d9e-461f-b844-66f4042de870: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-430b5b14-1d9e-461f-b844-66f4042de870', 'volume_size': 1}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:18 devstack sudo[105820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-83a5ef46-034a-42bd-b029-f99a4c94acb7
Sep 16 16:31:18 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:18 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c570e19d-1c62-4488-a22a-8dce9dbabe96 1073741824" returned: 0 in 0.668s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Flow 'volume_create_manager' (ac03ff9a-52ec-454d-97b0-f1f000899a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e2f7de-5275-4ba7-924b-f9c7c3e87653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c570e19d-1c62-4488-a22a-8dce9dbabe96 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e2f7de-5275-4ba7-924b-f9c7c3e87653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-875398176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a0ea9c-662f-44b8-9879-675f22570ec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bbb985562954499bd6d6a691facf9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:19Z,use_quota=True,user_id='33776cd4d42a43ee8b0b9fb8e34d946c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:18 devstack sudo[105825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c570e19d-1c62-4488-a22a-8dce9dbabe96
Sep 16 16:31:18 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb770ea-16df-46ef-aee9-b38fed26e008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb770ea-16df-46ef-aee9-b38fed26e008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a8e780-d77c-4788-9e11-c6c1a2774f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a8e780-d77c-4788-9e11-c6c1a2774f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0a0ea9c-662f-44b8-9879-675f22570ec4', 'volume_name': 'volume-d0a0ea9c-662f-44b8-9879-675f22570ec4', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb9f513-5360-4550-b41b-87f260d7f385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:18 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb9f513-5360-4550-b41b-87f260d7f385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c3b721-a3e0-4e18-a06d-11a352bb9197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:19 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Volume d0a0ea9c-662f-44b8-9879-675f22570ec4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0a0ea9c-662f-44b8-9879-675f22570ec4', 'volume_size': 1}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:19 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4062a1d5-4285-4402-a348-345e736024ea tempest-CreateVolumesFromImageTest-269734144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-83a5ef46-034a-42bd-b029-f99a4c94acb7" returned: 0 in 0.491s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4062a1d5-4285-4402-a348-345e736024ea tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-83a5ef46-034a-42bd-b029-f99a4c94acb7 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:19 devstack sudo[105828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-83a5ef46-034a-42bd-b029-f99a4c94acb7
Sep 16 16:31:19 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:19 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c570e19d-1c62-4488-a22a-8dce9dbabe96" returned: 0 in 0.354s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.675s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2002373852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5287526-8e68-450d-b6ce-eb748fa5f11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c029323bed0d47b2baa54a09734b58ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:13Z,use_quota=True,user_id='f15692f6ab1842da892fcc10039b6cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Creating volume e5287526-8e68-450d-b6ce-eb748fa5f11f {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:31:19 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e5287526-8e68-450d-b6ce-eb748fa5f11f 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b08d33-d6f8-424f-a38e-c45dcdca72b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c570e19d-1c62-4488-a22a-8dce9dbabe96', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:19 devstack sudo[105832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e5287526-8e68-450d-b6ce-eb748fa5f11f 1073741824
Sep 16 16:31:19 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d139b1-c3a1-4d45-be60-ce7236332dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:19 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4062a1d5-4285-4402-a348-345e736024ea tempest-CreateVolumesFromImageTest-269734144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-83a5ef46-034a-42bd-b029-f99a4c94acb7" returned: 0 in 0.332s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:19 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Volume volume-c570e19d-1c62-4488-a22a-8dce9dbabe96 (c570e19d-1c62-4488-a22a-8dce9dbabe96): created successfully
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d139b1-c3a1-4d45-be60-ce7236332dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Flow 'volume_create_manager' (ecbd7edf-86f2-41f0-97da-60e258915d3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4062a1d5-4285-4402-a348-345e736024ea tempest-CreateVolumesFromImageTest-269734144 None] Lock "cinder-quobyte-83a5ef46-034a-42bd-b029-f99a4c94acb7" released by "delete_volume" :: held 0.919s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Flow 'volume_create_manager' (25dc850f-a0e0-42ef-a4d4-918faef88065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af63bf9-4627-4985-80a5-778867004119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:19 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-ff5228d3-07cb-4d0c-b9d8-8194e813aae2 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Created volume successfully.
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af63bf9-4627-4985-80a5-778867004119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-687581756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2211cd-db75-41e1-9c97-443d415dd925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bbb985562954499bd6d6a691facf9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:19Z,use_quota=True,user_id='33776cd4d42a43ee8b0b9fb8e34d946c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889dcd33-ca38-4d11-add5-607e3cc1ce0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889dcd33-ca38-4d11-add5-607e3cc1ce0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e592411-3321-48f1-bb53-797f56eb9d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e592411-3321-48f1-bb53-797f56eb9d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb2211cd-db75-41e1-9c97-443d415dd925', 'volume_name': 'volume-bb2211cd-db75-41e1-9c97-443d415dd925', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92440eef-7461-49d9-87ec-5da149ff42c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92440eef-7461-49d9-87ec-5da149ff42c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f75a5b-f20d-43bc-b90f-9d43c4e5cb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:19 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Volume bb2211cd-db75-41e1-9c97-443d415dd925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb2211cd-db75-41e1-9c97-443d415dd925', 'volume_size': 1}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-4062a1d5-4285-4402-a348-345e736024ea tempest-CreateVolumesFromImageTest-269734144 None] Created reservations ['8579b937-3500-440a-a511-66e711c09555', '8bd2882d-2399-44a7-b1f8-9a633133f43b', 'fdde74ec-eae3-4afb-96d4-70eceb0fb1ad', 'c24c19d1-78fe-4523-8953-aa2b1a922e6a'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4062a1d5-4285-4402-a348-345e736024ea tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4062a1d5-4285-4402-a348-345e736024ea tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4062a1d5-4285-4402-a348-345e736024ea tempest-CreateVolumesFromImageTest-269734144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4062a1d5-4285-4402-a348-345e736024ea tempest-CreateVolumesFromImageTest-269734144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4062a1d5-4285-4402-a348-345e736024ea tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4062a1d5-4285-4402-a348-345e736024ea tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:19 devstack sudo[105837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:31:19 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:19 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e5287526-8e68-450d-b6ce-eb748fa5f11f 1073741824" returned: 0 in 0.553s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e5287526-8e68-450d-b6ce-eb748fa5f11f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:19 devstack sudo[105841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e5287526-8e68-450d-b6ce-eb748fa5f11f
Sep 16 16:31:19 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:20 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4062a1d5-4285-4402-a348-345e736024ea tempest-CreateVolumesFromImageTest-269734144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.389s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4062a1d5-4285-4402-a348-345e736024ea tempest-CreateVolumesFromImageTest-269734144 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:31:20 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-4062a1d5-4285-4402-a348-345e736024ea tempest-CreateVolumesFromImageTest-269734144 None] Deleted volume successfully.
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4062a1d5-4285-4402-a348-345e736024ea tempest-CreateVolumesFromImageTest-269734144 None] Lock "cinder-83a5ef46-034a-42bd-b029-f99a4c94acb7-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:20 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e5287526-8e68-450d-b6ce-eb748fa5f11f" returned: 0 in 0.322s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.083s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2041862463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609f7854-1616-4b45-a7bd-e2b86f3cf68c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c029323bed0d47b2baa54a09734b58ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:14Z,use_quota=True,user_id='f15692f6ab1842da892fcc10039b6cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Creating volume 609f7854-1616-4b45-a7bd-e2b86f3cf68c {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:31:20 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-609f7854-1616-4b45-a7bd-e2b86f3cf68c 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:20 devstack sudo[105844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-609f7854-1616-4b45-a7bd-e2b86f3cf68c 1073741824
Sep 16 16:31:20 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3381b413-130c-4b2e-8420-2f2d6b6d2baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5287526-8e68-450d-b6ce-eb748fa5f11f', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b4b359-1366-411f-afaa-9aa6934d3c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:20 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Volume volume-e5287526-8e68-450d-b6ce-eb748fa5f11f (e5287526-8e68-450d-b6ce-eb748fa5f11f): created successfully
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b4b359-1366-411f-afaa-9aa6934d3c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Flow 'volume_create_manager' (4ac2ca63-71c4-40c7-9850-9ea6f93e3dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:20 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-baad9e7e-cc5f-4102-be26-d6aaa1bef357 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Created volume successfully.
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e7208a34-8e32-4087-a55c-1111425c5f0a tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "cinder-fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e7208a34-8e32-4087-a55c-1111425c5f0a tempest-CreateVolumesFromImageTest-269734144 None] Lock "cinder-fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e7208a34-8e32-4087-a55c-1111425c5f0a tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "cinder-quobyte-fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e7208a34-8e32-4087-a55c-1111425c5f0a tempest-CreateVolumesFromImageTest-269734144 None] Lock "cinder-quobyte-fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c" acquired by "delete_volume" :: waited 0.023s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd751a6-f88c-4e0b-9b03-56af9e676734]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e7208a34-8e32-4087-a55c-1111425c5f0a tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:20 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-609f7854-1616-4b45-a7bd-e2b86f3cf68c 1073741824" returned: 0 in 0.528s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-609f7854-1616-4b45-a7bd-e2b86f3cf68c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:20 devstack sudo[105850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c
Sep 16 16:31:20 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:20 devstack sudo[105851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-609f7854-1616-4b45-a7bd-e2b86f3cf68c
Sep 16 16:31:20 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:21 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e7208a34-8e32-4087-a55c-1111425c5f0a tempest-CreateVolumesFromImageTest-269734144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c" returned: 0 in 0.408s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e7208a34-8e32-4087-a55c-1111425c5f0a tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:21 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-609f7854-1616-4b45-a7bd-e2b86f3cf68c" returned: 0 in 0.316s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:21 devstack sudo[105859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c
Sep 16 16:31:21 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.718s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2117358998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e010b2e-ec3b-4b9f-a4ea-8005eca282c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c029323bed0d47b2baa54a09734b58ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:14Z,use_quota=True,user_id='f15692f6ab1842da892fcc10039b6cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Creating volume 0e010b2e-ec3b-4b9f-a4ea-8005eca282c5 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:31:21 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0e010b2e-ec3b-4b9f-a4ea-8005eca282c5 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed9bda8-1a1e-4ce7-9164-8d3f907c24e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-609f7854-1616-4b45-a7bd-e2b86f3cf68c', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af44dc7-1792-47fa-9ec5-eebf0d926903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:21 devstack sudo[105861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0e010b2e-ec3b-4b9f-a4ea-8005eca282c5 1073741824
Sep 16 16:31:21 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:21 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Volume volume-609f7854-1616-4b45-a7bd-e2b86f3cf68c (609f7854-1616-4b45-a7bd-e2b86f3cf68c): created successfully
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af44dc7-1792-47fa-9ec5-eebf0d926903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Flow 'volume_create_manager' (61261951-74cc-406e-9018-7a2218cafb81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:21 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-5c846bc1-6861-4612-93db-99bf5fb70d2f tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Created volume successfully.
Sep 16 16:31:21 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e7208a34-8e32-4087-a55c-1111425c5f0a tempest-CreateVolumesFromImageTest-269734144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c" returned: 0 in 0.316s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e7208a34-8e32-4087-a55c-1111425c5f0a tempest-CreateVolumesFromImageTest-269734144 None] Lock "cinder-quobyte-fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c" released by "delete_volume" :: held 0.779s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-e7208a34-8e32-4087-a55c-1111425c5f0a tempest-CreateVolumesFromImageTest-269734144 None] Created reservations ['b937c5be-31e4-4dab-bf37-130bbc161c8c', 'a870b5df-beaa-450c-b6ce-1fbcbb6bf33a', 'fd0f3a13-de61-45e1-a83a-54d53d11aae6', '326cb36c-6288-41fc-a211-b3527d5d16f8'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e7208a34-8e32-4087-a55c-1111425c5f0a tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e7208a34-8e32-4087-a55c-1111425c5f0a tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e7208a34-8e32-4087-a55c-1111425c5f0a tempest-CreateVolumesFromImageTest-269734144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e7208a34-8e32-4087-a55c-1111425c5f0a tempest-CreateVolumesFromImageTest-269734144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e7208a34-8e32-4087-a55c-1111425c5f0a tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e7208a34-8e32-4087-a55c-1111425c5f0a tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:21 devstack sudo[105867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:31:21 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:21 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0e010b2e-ec3b-4b9f-a4ea-8005eca282c5 1073741824" returned: 0 in 0.524s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0e010b2e-ec3b-4b9f-a4ea-8005eca282c5 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:21 devstack sudo[105870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0e010b2e-ec3b-4b9f-a4ea-8005eca282c5
Sep 16 16:31:21 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-150efc39-cb84-4be4-954a-1941e92bf376 tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "cinder-4ca607a0-d901-4efb-a8df-db41a4a40c69-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-150efc39-cb84-4be4-954a-1941e92bf376 tempest-CreateVolumesFromImageTest-269734144 None] Lock "cinder-4ca607a0-d901-4efb-a8df-db41a4a40c69-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-150efc39-cb84-4be4-954a-1941e92bf376 tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "cinder-quobyte-4ca607a0-d901-4efb-a8df-db41a4a40c69" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-150efc39-cb84-4be4-954a-1941e92bf376 tempest-CreateVolumesFromImageTest-269734144 None] Lock "cinder-quobyte-4ca607a0-d901-4efb-a8df-db41a4a40c69" acquired by "delete_volume" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca018f8-5c60-4ba9-a04f-f4559b9616ed]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-150efc39-cb84-4be4-954a-1941e92bf376 tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4ca607a0-d901-4efb-a8df-db41a4a40c69 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:21 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e7208a34-8e32-4087-a55c-1111425c5f0a tempest-CreateVolumesFromImageTest-269734144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.332s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:21 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-e7208a34-8e32-4087-a55c-1111425c5f0a tempest-CreateVolumesFromImageTest-269734144 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:31:21 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-e7208a34-8e32-4087-a55c-1111425c5f0a tempest-CreateVolumesFromImageTest-269734144 None] Deleted volume successfully.
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e7208a34-8e32-4087-a55c-1111425c5f0a tempest-CreateVolumesFromImageTest-269734144 None] Lock "cinder-fd3e161a-480e-4b3a-bd4c-ba6fd2c7ef4c-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:22 devstack sudo[105873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4ca607a0-d901-4efb-a8df-db41a4a40c69
Sep 16 16:31:22 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:22 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0e010b2e-ec3b-4b9f-a4ea-8005eca282c5" returned: 0 in 0.330s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.193s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1138720641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba66244-1783-4c0d-9736-820a213559a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c029323bed0d47b2baa54a09734b58ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:15Z,use_quota=True,user_id='f15692f6ab1842da892fcc10039b6cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Creating volume 6ba66244-1783-4c0d-9736-820a213559a2 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:31:22 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6ba66244-1783-4c0d-9736-820a213559a2 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:22 devstack sudo[105876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6ba66244-1783-4c0d-9736-820a213559a2 1073741824
Sep 16 16:31:22 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ef5ced-8106-497c-aa81-9562c449a1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e010b2e-ec3b-4b9f-a4ea-8005eca282c5', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e68f14c-bb4d-4e33-99f2-1919f18179c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:22 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Volume volume-0e010b2e-ec3b-4b9f-a4ea-8005eca282c5 (0e010b2e-ec3b-4b9f-a4ea-8005eca282c5): created successfully
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e68f14c-bb4d-4e33-99f2-1919f18179c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Flow 'volume_create_manager' (b4ed8ffe-f7db-4265-b6ae-64ee397695e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:22 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-3bcd60d8-02f5-4a59-82a7-539b65d63393 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Created volume successfully.
Sep 16 16:31:22 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-150efc39-cb84-4be4-954a-1941e92bf376 tempest-CreateVolumesFromImageTest-269734144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4ca607a0-d901-4efb-a8df-db41a4a40c69" returned: 0 in 0.477s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-150efc39-cb84-4be4-954a-1941e92bf376 tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4ca607a0-d901-4efb-a8df-db41a4a40c69 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:22 devstack sudo[105884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4ca607a0-d901-4efb-a8df-db41a4a40c69
Sep 16 16:31:22 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:22 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6ba66244-1783-4c0d-9736-820a213559a2 1073741824" returned: 0 in 0.550s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6ba66244-1783-4c0d-9736-820a213559a2 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:22 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-150efc39-cb84-4be4-954a-1941e92bf376 tempest-CreateVolumesFromImageTest-269734144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4ca607a0-d901-4efb-a8df-db41a4a40c69" returned: 0 in 0.288s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:22 devstack sudo[105888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6ba66244-1783-4c0d-9736-820a213559a2
Sep 16 16:31:22 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-150efc39-cb84-4be4-954a-1941e92bf376 tempest-CreateVolumesFromImageTest-269734144 None] Lock "cinder-quobyte-4ca607a0-d901-4efb-a8df-db41a4a40c69" released by "delete_volume" :: held 0.838s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-150efc39-cb84-4be4-954a-1941e92bf376 tempest-CreateVolumesFromImageTest-269734144 None] Created reservations ['e9dbdaa2-d20e-4ea5-96e1-effd492ec217', '44f47e5b-ad9e-4933-a5cd-b868470180e4', 'fe0b95ef-01f5-4e59-bd23-f4cdd27c8d86', '6b086b4b-c365-4a34-a7ac-d5211523ebde'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-150efc39-cb84-4be4-954a-1941e92bf376 tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-150efc39-cb84-4be4-954a-1941e92bf376 tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-150efc39-cb84-4be4-954a-1941e92bf376 tempest-CreateVolumesFromImageTest-269734144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-150efc39-cb84-4be4-954a-1941e92bf376 tempest-CreateVolumesFromImageTest-269734144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-150efc39-cb84-4be4-954a-1941e92bf376 tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-150efc39-cb84-4be4-954a-1941e92bf376 tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:22 devstack sudo[105890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:31:22 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:23 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-273a8a09-e121-4946-9da4-eac89e81ac0d tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "cinder-148fe60e-fa03-4212-afd9-dc51b5dcb496-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6ba66244-1783-4c0d-9736-820a213559a2" returned: 0 in 0.298s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.910s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7ad68d-32d2-4128-bcb8-d4afeff84b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe6399a952d46a8943cde67e0dbaa36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:14Z,use_quota=True,user_id='b853a898cebc49f5a5d11235926352ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d72b191-4c39-404b-92bd-0b4ec8a1626d),volume_type_id=9d72b191-4c39-404b-92bd-0b4ec8a1626d)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Creating volume 2a7ad68d-32d2-4128-bcb8-d4afeff84b0f {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:31:23 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a868b44-806e-4a0f-8a7f-981ae55aa1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ba66244-1783-4c0d-9736-820a213559a2', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:23 devstack sudo[105893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f 1073741824
Sep 16 16:31:23 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76feebff-4472-40ac-bd8f-bded59d1c214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-273a8a09-e121-4946-9da4-eac89e81ac0d tempest-CreateVolumesFromImageTest-269734144 None] Lock "cinder-148fe60e-fa03-4212-afd9-dc51b5dcb496-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:23 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Volume volume-6ba66244-1783-4c0d-9736-820a213559a2 (6ba66244-1783-4c0d-9736-820a213559a2): created successfully
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76feebff-4472-40ac-bd8f-bded59d1c214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Flow 'volume_create_manager' (d16da7f7-55bf-4713-b99f-d9f2336e1522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:23 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-a5dff842-9930-4c85-959a-7d196f9b7982 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Created volume successfully.
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-273a8a09-e121-4946-9da4-eac89e81ac0d tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "cinder-quobyte-148fe60e-fa03-4212-afd9-dc51b5dcb496" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-273a8a09-e121-4946-9da4-eac89e81ac0d tempest-CreateVolumesFromImageTest-269734144 None] Lock "cinder-quobyte-148fe60e-fa03-4212-afd9-dc51b5dcb496" acquired by "delete_volume" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:23 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-150efc39-cb84-4be4-954a-1941e92bf376 tempest-CreateVolumesFromImageTest-269734144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.304s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-150efc39-cb84-4be4-954a-1941e92bf376 tempest-CreateVolumesFromImageTest-269734144 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:31:23 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-150efc39-cb84-4be4-954a-1941e92bf376 tempest-CreateVolumesFromImageTest-269734144 None] Deleted volume successfully.
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d420ac4-dcc9-4910-afb2-9a4198093cc3]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-273a8a09-e121-4946-9da4-eac89e81ac0d tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-148fe60e-fa03-4212-afd9-dc51b5dcb496 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-150efc39-cb84-4be4-954a-1941e92bf376 tempest-CreateVolumesFromImageTest-269734144 None] Lock "cinder-4ca607a0-d901-4efb-a8df-db41a4a40c69-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:23 devstack sudo[105896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-148fe60e-fa03-4212-afd9-dc51b5dcb496
Sep 16 16:31:23 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:23 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:23 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f 1073741824" returned: 0 in 0.587s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-273a8a09-e121-4946-9da4-eac89e81ac0d tempest-CreateVolumesFromImageTest-269734144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-148fe60e-fa03-4212-afd9-dc51b5dcb496" returned: 0 in 0.429s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-273a8a09-e121-4946-9da4-eac89e81ac0d tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-148fe60e-fa03-4212-afd9-dc51b5dcb496 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:23 devstack sudo[105905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-148fe60e-fa03-4212-afd9-dc51b5dcb496
Sep 16 16:31:23 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a4e7828f-51aa-4235-97c0-046eb03d8f8c tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "cinder-6ba66244-1783-4c0d-9736-820a213559a2-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:23 devstack sudo[105907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f
Sep 16 16:31:23 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a4e7828f-51aa-4235-97c0-046eb03d8f8c tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-6ba66244-1783-4c0d-9736-820a213559a2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a4e7828f-51aa-4235-97c0-046eb03d8f8c tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "cinder-quobyte-6ba66244-1783-4c0d-9736-820a213559a2" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a4e7828f-51aa-4235-97c0-046eb03d8f8c tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-quobyte-6ba66244-1783-4c0d-9736-820a213559a2" acquired by "delete_volume" :: waited 0.018s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[82691754-b97a-4e24-a366-166f26b148e1]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a4e7828f-51aa-4235-97c0-046eb03d8f8c tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6ba66244-1783-4c0d-9736-820a213559a2 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:24 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f" returned: 0 in 0.308s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:24 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.387s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-37325084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea78372-0e08-4330-9cdb-ac8cbf5676a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bbb985562954499bd6d6a691facf9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:17Z,use_quota=True,user_id='33776cd4d42a43ee8b0b9fb8e34d946c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Creating volume fea78372-0e08-4330-9cdb-ac8cbf5676a2 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:31:24 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fea78372-0e08-4330-9cdb-ac8cbf5676a2 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:24 devstack sudo[105909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6ba66244-1783-4c0d-9736-820a213559a2
Sep 16 16:31:24 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-273a8a09-e121-4946-9da4-eac89e81ac0d tempest-CreateVolumesFromImageTest-269734144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-148fe60e-fa03-4212-afd9-dc51b5dcb496" returned: 0 in 0.386s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:24 devstack sudo[105913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fea78372-0e08-4330-9cdb-ac8cbf5676a2 1073741824
Sep 16 16:31:24 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-273a8a09-e121-4946-9da4-eac89e81ac0d tempest-CreateVolumesFromImageTest-269734144 None] Lock "cinder-quobyte-148fe60e-fa03-4212-afd9-dc51b5dcb496" released by "delete_volume" :: held 0.888s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Attempting download of b799d573-9607-4723-8e96-df0605e981fe ((None, [{'url': 'file:///opt/stack/data/glance/images/b799d573-9607-4723-8e96-df0605e981fe', 'metadata': {}}])) to volume 2a7ad68d-32d2-4128-bcb8-d4afeff84b0f. {{(pid=86165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-273a8a09-e121-4946-9da4-eac89e81ac0d tempest-CreateVolumesFromImageTest-269734144 None] Created reservations ['b8b213d8-fb5d-4323-8b51-d4191f75e3a6', '4fe3cee0-c79b-48b0-ba1c-c8f75bd2bc8e', 'e0556876-f3e4-4f90-aae1-78cc8fd782d5', '9d498ffb-2dd1-46f3-9660-6b52556e92c7'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b048c06-6b60-49f1-b5d7-8f47bb4dd4ec]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b799d573-9607-4723-8e96-df0605e981fe_a0y6je9r {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-273a8a09-e121-4946-9da4-eac89e81ac0d tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-273a8a09-e121-4946-9da4-eac89e81ac0d tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-273a8a09-e121-4946-9da4-eac89e81ac0d tempest-CreateVolumesFromImageTest-269734144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-273a8a09-e121-4946-9da4-eac89e81ac0d tempest-CreateVolumesFromImageTest-269734144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-273a8a09-e121-4946-9da4-eac89e81ac0d tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-273a8a09-e121-4946-9da4-eac89e81ac0d tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:24 devstack sudo[105915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b799d573-9607-4723-8e96-df0605e981fe_a0y6je9r
Sep 16 16:31:24 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:24 devstack sudo[105918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:31:24 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:24 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a4e7828f-51aa-4235-97c0-046eb03d8f8c tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6ba66244-1783-4c0d-9736-820a213559a2" returned: 0 in 0.560s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a4e7828f-51aa-4235-97c0-046eb03d8f8c tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6ba66244-1783-4c0d-9736-820a213559a2 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:24 devstack sudo[105925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6ba66244-1783-4c0d-9736-820a213559a2
Sep 16 16:31:24 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:24 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b799d573-9607-4723-8e96-df0605e981fe_a0y6je9r" returned: 0 in 0.457s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b799d573-9607-4723-8e96-df0605e981fe_a0y6je9r {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:24 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-273a8a09-e121-4946-9da4-eac89e81ac0d tempest-CreateVolumesFromImageTest-269734144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.344s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-273a8a09-e121-4946-9da4-eac89e81ac0d tempest-CreateVolumesFromImageTest-269734144 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:31:24 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-273a8a09-e121-4946-9da4-eac89e81ac0d tempest-CreateVolumesFromImageTest-269734144 None] Deleted volume successfully.
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-273a8a09-e121-4946-9da4-eac89e81ac0d tempest-CreateVolumesFromImageTest-269734144 None] Lock "cinder-148fe60e-fa03-4212-afd9-dc51b5dcb496-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:24 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fea78372-0e08-4330-9cdb-ac8cbf5676a2 1073741824" returned: 0 in 0.715s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:24 devstack sudo[105931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b799d573-9607-4723-8e96-df0605e981fe_a0y6je9r
Sep 16 16:31:24 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fea78372-0e08-4330-9cdb-ac8cbf5676a2 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:24 devstack sudo[105934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fea78372-0e08-4330-9cdb-ac8cbf5676a2
Sep 16 16:31:24 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:24 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a4e7828f-51aa-4235-97c0-046eb03d8f8c tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6ba66244-1783-4c0d-9736-820a213559a2" returned: 0 in 0.475s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a4e7828f-51aa-4235-97c0-046eb03d8f8c tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-quobyte-6ba66244-1783-4c0d-9736-820a213559a2" released by "delete_volume" :: held 1.105s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:24 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-a4e7828f-51aa-4235-97c0-046eb03d8f8c tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Created reservations ['e8e130d6-35af-4629-8b38-cdefb75fa6dc', 'fe414f9f-6e23-40a4-9af6-0305e707883c', '5f266c3a-96fe-48d6-9967-6123f4fd4232', '31753c23-f86d-46e6-b845-63cf354e38dc'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a4e7828f-51aa-4235-97c0-046eb03d8f8c tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a4e7828f-51aa-4235-97c0-046eb03d8f8c tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-a4e7828f-51aa-4235-97c0-046eb03d8f8c tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-a4e7828f-51aa-4235-97c0-046eb03d8f8c tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a4e7828f-51aa-4235-97c0-046eb03d8f8c tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a4e7828f-51aa-4235-97c0-046eb03d8f8c tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:25 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b799d573-9607-4723-8e96-df0605e981fe_a0y6je9r" returned: 1 in 0.466s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b799d573-9607-4723-8e96-df0605e981fe_a0y6je9r' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8cf3e6-a6b3-498a-beec-66404f2deaba]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:25 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fea78372-0e08-4330-9cdb-ac8cbf5676a2" returned: 0 in 0.314s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:31:25 devstack sudo[105939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:31:25 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.042s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1700110274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3775f27d-53f0-4c2d-9e0a-409a8802b974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bbb985562954499bd6d6a691facf9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:18Z,use_quota=True,user_id='33776cd4d42a43ee8b0b9fb8e34d946c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Creating volume 3775f27d-53f0-4c2d-9e0a-409a8802b974 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:31:25 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3775f27d-53f0-4c2d-9e0a-409a8802b974 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9316aaca-bdfd-4199-a5e4-db1078f83f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fea78372-0e08-4330-9cdb-ac8cbf5676a2', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f154b7-818d-41fe-bc78-dbfd32f6095d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:25 devstack sudo[105942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3775f27d-53f0-4c2d-9e0a-409a8802b974 1073741824
Sep 16 16:31:25 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:25 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Volume volume-fea78372-0e08-4330-9cdb-ac8cbf5676a2 (fea78372-0e08-4330-9cdb-ac8cbf5676a2): created successfully
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f154b7-818d-41fe-bc78-dbfd32f6095d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Flow 'volume_create_manager' (3641b5f8-e8e3-4eb2-a59a-f3be86c18bf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:25 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-77e2fb1b-8cab-4552-a7cb-cd2f624c5bd9 tempest-CreateVolumesFromSnapshotTest-993043390 None] Created volume successfully.
Sep 16 16:31:25 devstack sudo[105940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD
Sep 16 16:31:25 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ced53d72-c900-4c3c-a2db-2c03d3630bc6 tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "cinder-762e20b1-48b2-4d4e-a8ab-2fd24c016019-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ced53d72-c900-4c3c-a2db-2c03d3630bc6 tempest-CreateVolumesFromImageTest-269734144 None] Lock "cinder-762e20b1-48b2-4d4e-a8ab-2fd24c016019-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ced53d72-c900-4c3c-a2db-2c03d3630bc6 tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "cinder-quobyte-762e20b1-48b2-4d4e-a8ab-2fd24c016019" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ced53d72-c900-4c3c-a2db-2c03d3630bc6 tempest-CreateVolumesFromImageTest-269734144 None] Lock "cinder-quobyte-762e20b1-48b2-4d4e-a8ab-2fd24c016019" acquired by "delete_volume" :: waited 0.027s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:25 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8209d4b3-3b99-4a2c-a4ef-30fd1f0e4f7e]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ced53d72-c900-4c3c-a2db-2c03d3630bc6 tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-762e20b1-48b2-4d4e-a8ab-2fd24c016019 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:25 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a4e7828f-51aa-4235-97c0-046eb03d8f8c tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.461s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-a4e7828f-51aa-4235-97c0-046eb03d8f8c tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:31:25 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-a4e7828f-51aa-4235-97c0-046eb03d8f8c tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Deleted volume successfully.
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a4e7828f-51aa-4235-97c0-046eb03d8f8c tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-6ba66244-1783-4c0d-9736-820a213559a2-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:25 devstack sudo[105951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD
Sep 16 16:31:25 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:25 devstack sudo[105952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-762e20b1-48b2-4d4e-a8ab-2fd24c016019
Sep 16 16:31:25 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:25 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3775f27d-53f0-4c2d-9e0a-409a8802b974 1073741824" returned: 0 in 0.685s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3775f27d-53f0-4c2d-9e0a-409a8802b974 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:25 devstack sudo[105956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3775f27d-53f0-4c2d-9e0a-409a8802b974
Sep 16 16:31:25 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:25 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD" returned: 1 in 0.461s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] b799d573-9607-4723-8e96-df0605e981fe was raw, converting to qcow2 {{(pid=86165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:25 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:25 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5c3d3cb8-0384-483f-9d8d-169b66e60b12 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "cinder-0e010b2e-ec3b-4b9f-a4ea-8005eca282c5-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ced53d72-c900-4c3c-a2db-2c03d3630bc6 tempest-CreateVolumesFromImageTest-269734144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-762e20b1-48b2-4d4e-a8ab-2fd24c016019" returned: 0 in 0.489s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ced53d72-c900-4c3c-a2db-2c03d3630bc6 tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-762e20b1-48b2-4d4e-a8ab-2fd24c016019 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:26 devstack sudo[105964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f
Sep 16 16:31:26 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5c3d3cb8-0384-483f-9d8d-169b66e60b12 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-0e010b2e-ec3b-4b9f-a4ea-8005eca282c5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:26 devstack sudo[105965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-762e20b1-48b2-4d4e-a8ab-2fd24c016019
Sep 16 16:31:26 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5c3d3cb8-0384-483f-9d8d-169b66e60b12 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "cinder-quobyte-0e010b2e-ec3b-4b9f-a4ea-8005eca282c5" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5c3d3cb8-0384-483f-9d8d-169b66e60b12 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-quobyte-0e010b2e-ec3b-4b9f-a4ea-8005eca282c5" acquired by "delete_volume" :: waited 0.035s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:26 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3775f27d-53f0-4c2d-9e0a-409a8802b974" returned: 0 in 0.314s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67c76d9-e19c-42dc-b181-79880c168dca]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.558s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1345664111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=430b5b14-1d9e-461f-b844-66f4042de870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bbb985562954499bd6d6a691facf9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:18Z,use_quota=True,user_id='33776cd4d42a43ee8b0b9fb8e34d946c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Creating volume 430b5b14-1d9e-461f-b844-66f4042de870 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:31:26 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-430b5b14-1d9e-461f-b844-66f4042de870 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5c3d3cb8-0384-483f-9d8d-169b66e60b12 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0e010b2e-ec3b-4b9f-a4ea-8005eca282c5 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:26 devstack sudo[105969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-430b5b14-1d9e-461f-b844-66f4042de870 1073741824
Sep 16 16:31:26 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a85d57-bf22-42d5-947c-471c13e381bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3775f27d-53f0-4c2d-9e0a-409a8802b974', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53e6d8c-3e44-49f9-90b2-fcd0372ecf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:26 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Volume volume-3775f27d-53f0-4c2d-9e0a-409a8802b974 (3775f27d-53f0-4c2d-9e0a-409a8802b974): created successfully
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53e6d8c-3e44-49f9-90b2-fcd0372ecf9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Flow 'volume_create_manager' (c3bdab0e-ea38-4681-baaa-632040438c3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:26 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-25dd1c9f-01c8-4889-85e2-9e2ffe653654 tempest-CreateVolumesFromSnapshotTest-993043390 None] Created volume successfully.
Sep 16 16:31:26 devstack sudo[105970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0e010b2e-ec3b-4b9f-a4ea-8005eca282c5
Sep 16 16:31:26 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:26 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ced53d72-c900-4c3c-a2db-2c03d3630bc6 tempest-CreateVolumesFromImageTest-269734144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-762e20b1-48b2-4d4e-a8ab-2fd24c016019" returned: 0 in 0.408s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ced53d72-c900-4c3c-a2db-2c03d3630bc6 tempest-CreateVolumesFromImageTest-269734144 None] Lock "cinder-quobyte-762e20b1-48b2-4d4e-a8ab-2fd24c016019" released by "delete_volume" :: held 0.959s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-ced53d72-c900-4c3c-a2db-2c03d3630bc6 tempest-CreateVolumesFromImageTest-269734144 None] Created reservations ['d59c7017-e730-4abc-b3b9-5ee902aa0dcd', 'f4aa6391-38d2-4af2-8ad3-f223fbe2f2ca', 'edbecbfe-c7e1-4596-a90f-870fe677079f', '841970ba-dba6-4fdd-9bf6-ff884712bb62'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ced53d72-c900-4c3c-a2db-2c03d3630bc6 tempest-CreateVolumesFromImageTest-269734144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ced53d72-c900-4c3c-a2db-2c03d3630bc6 tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ced53d72-c900-4c3c-a2db-2c03d3630bc6 tempest-CreateVolumesFromImageTest-269734144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ced53d72-c900-4c3c-a2db-2c03d3630bc6 tempest-CreateVolumesFromImageTest-269734144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ced53d72-c900-4c3c-a2db-2c03d3630bc6 tempest-CreateVolumesFromImageTest-269734144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ced53d72-c900-4c3c-a2db-2c03d3630bc6 tempest-CreateVolumesFromImageTest-269734144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:26 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f" returned: 0 in 0.719s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b799d573-9607-4723-8e96-df0605e981fe_vqi1kirgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:31:26 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Converted 0.00 MB image at 0.00 MB/s
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:26 devstack sudo[105983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:31:26 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:26 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:26 devstack sudo[105986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f 1G
Sep 16 16:31:26 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5c3d3cb8-0384-483f-9d8d-169b66e60b12 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0e010b2e-ec3b-4b9f-a4ea-8005eca282c5" returned: 0 in 0.541s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5c3d3cb8-0384-483f-9d8d-169b66e60b12 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0e010b2e-ec3b-4b9f-a4ea-8005eca282c5 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:26 devstack sudo[105989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0e010b2e-ec3b-4b9f-a4ea-8005eca282c5
Sep 16 16:31:26 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:26 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-430b5b14-1d9e-461f-b844-66f4042de870 1073741824" returned: 0 in 0.626s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-430b5b14-1d9e-461f-b844-66f4042de870 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:26 devstack sudo[105991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-430b5b14-1d9e-461f-b844-66f4042de870
Sep 16 16:31:26 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:27 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ced53d72-c900-4c3c-a2db-2c03d3630bc6 tempest-CreateVolumesFromImageTest-269734144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.394s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-ced53d72-c900-4c3c-a2db-2c03d3630bc6 tempest-CreateVolumesFromImageTest-269734144 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:31:27 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-ced53d72-c900-4c3c-a2db-2c03d3630bc6 tempest-CreateVolumesFromImageTest-269734144 None] Deleted volume successfully.
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ced53d72-c900-4c3c-a2db-2c03d3630bc6 tempest-CreateVolumesFromImageTest-269734144 None] Lock "cinder-762e20b1-48b2-4d4e-a8ab-2fd24c016019-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:27 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f 1G" returned: 0 in 0.463s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Downloaded image b799d573-9607-4723-8e96-df0605e981fe ((None, [{'url': 'file:///opt/stack/data/glance/images/b799d573-9607-4723-8e96-df0605e981fe', 'metadata': {}}])) to volume 2a7ad68d-32d2-4128-bcb8-d4afeff84b0f successfully. {{(pid=86165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Temporary image b799d573-9607-4723-8e96-df0605e981fe for user b853a898cebc49f5a5d11235926352ad is deleted. {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Marking volume 2a7ad68d-32d2-4128-bcb8-d4afeff84b0f as bootable. {{(pid=86165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 16:31:27 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5c3d3cb8-0384-483f-9d8d-169b66e60b12 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0e010b2e-ec3b-4b9f-a4ea-8005eca282c5" returned: 0 in 0.454s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Copying metadata from image b799d573-9607-4723-8e96-df0605e981fe to 2a7ad68d-32d2-4128-bcb8-d4afeff84b0f. {{(pid=86165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Creating volume glance metadata for volume 2a7ad68d-32d2-4128-bcb8-d4afeff84b0f backed by image b799d573-9607-4723-8e96-df0605e981fe with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b799d573-9607-4723-8e96-df0605e981fe', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7cea0e22a5b89bf710e139dbf22e1e1e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5c3d3cb8-0384-483f-9d8d-169b66e60b12 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-quobyte-0e010b2e-ec3b-4b9f-a4ea-8005eca282c5" released by "delete_volume" :: held 1.081s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:27 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-430b5b14-1d9e-461f-b844-66f4042de870" returned: 0 in 0.391s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.259s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-875398176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a0ea9c-662f-44b8-9879-675f22570ec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bbb985562954499bd6d6a691facf9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:19Z,use_quota=True,user_id='33776cd4d42a43ee8b0b9fb8e34d946c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Creating volume d0a0ea9c-662f-44b8-9879-675f22570ec4 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:31:27 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d0a0ea9c-662f-44b8-9879-675f22570ec4 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416f69ce-3667-4b83-94b2-86c919090a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-430b5b14-1d9e-461f-b844-66f4042de870', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:27 devstack sudo[106000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d0a0ea9c-662f-44b8-9879-675f22570ec4 1073741824
Sep 16 16:31:27 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b819869d-3ac4-4962-91b8-e99d8b931d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:27 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Volume volume-430b5b14-1d9e-461f-b844-66f4042de870 (430b5b14-1d9e-461f-b844-66f4042de870): created successfully
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b819869d-3ac4-4962-91b8-e99d8b931d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Flow 'volume_create_manager' (6284bb79-1df6-4757-80d6-adfb974faa7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-5c3d3cb8-0384-483f-9d8d-169b66e60b12 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Created reservations ['53450eb4-905e-4928-9cbc-c389b9049879', 'd85288c7-b8f7-4e6d-a124-6c8e5d7a564b', '251ef45d-badf-44e1-9011-5362a9c32c5c', 'cc682b15-95df-43aa-9f69-b3c463731bd2'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2799115b-54ca-4b8c-bbab-d21665c52939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f', 'volume_size': 1, 'image_id': 'b799d573-9607-4723-8e96-df0605e981fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b799d573-9607-4723-8e96-df0605e981fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7cea0e22a5b89bf710e139dbf22e1e1e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5fe6399a952d46a8943cde67e0dbaa36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ead9aa50c2008da02d128f2e4c865ab7dfb5742a2f53636c6ff0a0c7644bd5a76400a9c29c6e60b4a8ed87b02e1aa88f03f7bedfc042ae7e48dc4747285873f', 'id': 'b799d573-9607-4723-8e96-df0605e981fe', 'created_at': datetime.datetime(2026, 9, 16, 14, 31, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 31, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b799d573-9607-4723-8e96-df0605e981fe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e4c206510>}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5014982c-8449-4d54-9cf3-3a430bc1f3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:27 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-cb085399-f251-4fc2-982e-de1b41df23f1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Created volume successfully.
Sep 16 16:31:27 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Volume volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f (2a7ad68d-32d2-4128-bcb8-d4afeff84b0f): created successfully
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5014982c-8449-4d54-9cf3-3a430bc1f3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Flow 'volume_create_manager' (3189d197-4068-484f-851b-c599eb0402a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:27 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-1e8c9c3c-108d-40d7-8673-2121444fd660 tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Created volume successfully.
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5c3d3cb8-0384-483f-9d8d-169b66e60b12 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5c3d3cb8-0384-483f-9d8d-169b66e60b12 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5c3d3cb8-0384-483f-9d8d-169b66e60b12 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-5c3d3cb8-0384-483f-9d8d-169b66e60b12 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-5c3d3cb8-0384-483f-9d8d-169b66e60b12 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5c3d3cb8-0384-483f-9d8d-169b66e60b12 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:27 devstack sudo[106002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:31:27 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:27 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5c3d3cb8-0384-483f-9d8d-169b66e60b12 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.320s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-5c3d3cb8-0384-483f-9d8d-169b66e60b12 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:31:27 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-5c3d3cb8-0384-483f-9d8d-169b66e60b12 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Deleted volume successfully.
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5c3d3cb8-0384-483f-9d8d-169b66e60b12 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-0e010b2e-ec3b-4b9f-a4ea-8005eca282c5-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:27 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d0a0ea9c-662f-44b8-9879-675f22570ec4 1073741824" returned: 0 in 0.567s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d0a0ea9c-662f-44b8-9879-675f22570ec4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:27 devstack sudo[106008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d0a0ea9c-662f-44b8-9879-675f22570ec4
Sep 16 16:31:27 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9513de48-dc91-4525-9988-d91b702059cb tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Acquiring lock "cinder-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9513de48-dc91-4525-9988-d91b702059cb tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Lock "cinder-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9513de48-dc91-4525-9988-d91b702059cb tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Acquiring lock "cinder-quobyte-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9513de48-dc91-4525-9988-d91b702059cb tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Lock "cinder-quobyte-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f" acquired by "delete_volume" :: waited 0.030s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:28 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d0a0ea9c-662f-44b8-9879-675f22570ec4" returned: 0 in 0.352s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.725s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-687581756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2211cd-db75-41e1-9c97-443d415dd925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bbb985562954499bd6d6a691facf9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:19Z,use_quota=True,user_id='33776cd4d42a43ee8b0b9fb8e34d946c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Creating volume bb2211cd-db75-41e1-9c97-443d415dd925 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:31:28 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bb2211cd-db75-41e1-9c97-443d415dd925 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b500f09-b18f-4fcb-81c7-4d15216571a1]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9513de48-dc91-4525-9988-d91b702059cb tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:28 devstack sudo[106011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bb2211cd-db75-41e1-9c97-443d415dd925 1073741824
Sep 16 16:31:28 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c3b721-a3e0-4e18-a06d-11a352bb9197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0a0ea9c-662f-44b8-9879-675f22570ec4', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac6bd6c-6f44-428d-b046-70f80ef9d29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7c30abfa-b8b2-46e3-9e46-b1d66c643548 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "cinder-609f7854-1616-4b45-a7bd-e2b86f3cf68c-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:28 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Volume volume-d0a0ea9c-662f-44b8-9879-675f22570ec4 (d0a0ea9c-662f-44b8-9879-675f22570ec4): created successfully
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac6bd6c-6f44-428d-b046-70f80ef9d29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Flow 'volume_create_manager' (ac03ff9a-52ec-454d-97b0-f1f000899a16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7c30abfa-b8b2-46e3-9e46-b1d66c643548 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-609f7854-1616-4b45-a7bd-e2b86f3cf68c-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:28 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-99e6731d-836a-4135-af92-0fa5e57975c1 tempest-CreateVolumesFromSnapshotTest-993043390 None] Created volume successfully.
Sep 16 16:31:28 devstack sudo[106012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f
Sep 16 16:31:28 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7c30abfa-b8b2-46e3-9e46-b1d66c643548 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "cinder-quobyte-609f7854-1616-4b45-a7bd-e2b86f3cf68c" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7c30abfa-b8b2-46e3-9e46-b1d66c643548 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-quobyte-609f7854-1616-4b45-a7bd-e2b86f3cf68c" acquired by "delete_volume" :: waited 0.029s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea45c2e8-5893-480b-ac0d-cbb2db416bfa]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7c30abfa-b8b2-46e3-9e46-b1d66c643548 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-609f7854-1616-4b45-a7bd-e2b86f3cf68c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:28 devstack sudo[106015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-609f7854-1616-4b45-a7bd-e2b86f3cf68c
Sep 16 16:31:28 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:28 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9513de48-dc91-4525-9988-d91b702059cb tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f" returned: 0 in 0.592s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9513de48-dc91-4525-9988-d91b702059cb tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:28 devstack sudo[106024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f
Sep 16 16:31:28 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:28 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bb2211cd-db75-41e1-9c97-443d415dd925 1073741824" returned: 0 in 0.719s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bb2211cd-db75-41e1-9c97-443d415dd925 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:29 devstack sudo[106027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bb2211cd-db75-41e1-9c97-443d415dd925
Sep 16 16:31:29 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:29 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7c30abfa-b8b2-46e3-9e46-b1d66c643548 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-609f7854-1616-4b45-a7bd-e2b86f3cf68c" returned: 0 in 0.683s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7c30abfa-b8b2-46e3-9e46-b1d66c643548 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-609f7854-1616-4b45-a7bd-e2b86f3cf68c {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:29 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:29 devstack sudo[106034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-609f7854-1616-4b45-a7bd-e2b86f3cf68c
Sep 16 16:31:29 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9513de48-dc91-4525-9988-d91b702059cb tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f" returned: 0 in 0.418s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9513de48-dc91-4525-9988-d91b702059cb tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Lock "cinder-quobyte-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f" released by "delete_volume" :: held 1.115s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-9513de48-dc91-4525-9988-d91b702059cb tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Created reservations ['2258c0f6-d2d5-45c4-85d0-5e37bdfe351a', '2c7260ab-6b15-4c90-90d3-af9cdd827509', 'bde9be99-b302-42d6-852d-eb34bce697af', 'd0ae596b-d303-49fe-9cbd-94a01ed93d7e'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:31:29 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bb2211cd-db75-41e1-9c97-443d415dd925" returned: 0 in 0.475s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f75a5b-f20d-43bc-b90f-9d43c4e5cb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb2211cd-db75-41e1-9c97-443d415dd925', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7dcb34e-aff2-4c37-8120-8574330cec0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9513de48-dc91-4525-9988-d91b702059cb tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9513de48-dc91-4525-9988-d91b702059cb tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9513de48-dc91-4525-9988-d91b702059cb tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9513de48-dc91-4525-9988-d91b702059cb tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9513de48-dc91-4525-9988-d91b702059cb tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9513de48-dc91-4525-9988-d91b702059cb tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:29 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Volume volume-bb2211cd-db75-41e1-9c97-443d415dd925 (bb2211cd-db75-41e1-9c97-443d415dd925): created successfully
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7dcb34e-aff2-4c37-8120-8574330cec0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Flow 'volume_create_manager' (25dc850f-a0e0-42ef-a4d4-918faef88065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:29 devstack sudo[106037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:31:29 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:29 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-0272bc6f-a17c-4a38-88ce-3147aec9d389 tempest-CreateVolumesFromSnapshotTest-993043390 None] Created volume successfully.
Sep 16 16:31:29 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7c30abfa-b8b2-46e3-9e46-b1d66c643548 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-609f7854-1616-4b45-a7bd-e2b86f3cf68c" returned: 0 in 0.451s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7c30abfa-b8b2-46e3-9e46-b1d66c643548 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-quobyte-609f7854-1616-4b45-a7bd-e2b86f3cf68c" released by "delete_volume" :: held 1.212s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-7c30abfa-b8b2-46e3-9e46-b1d66c643548 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Created reservations ['cd93ce6e-7a0a-4f9f-b03f-8c31e328dc4a', 'c70b3ea2-965d-4846-9583-12db48f41f9b', '530c1f12-aa64-437a-aa86-8faf6c3145a7', '4f2b9042-a54e-4bd6-b0be-34eb13b685fe'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7c30abfa-b8b2-46e3-9e46-b1d66c643548 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7c30abfa-b8b2-46e3-9e46-b1d66c643548 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7c30abfa-b8b2-46e3-9e46-b1d66c643548 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7c30abfa-b8b2-46e3-9e46-b1d66c643548 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7c30abfa-b8b2-46e3-9e46-b1d66c643548 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7c30abfa-b8b2-46e3-9e46-b1d66c643548 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:29 devstack sudo[106041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:31:29 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:29 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9513de48-dc91-4525-9988-d91b702059cb tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.340s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-9513de48-dc91-4525-9988-d91b702059cb tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:31:29 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-9513de48-dc91-4525-9988-d91b702059cb tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Deleted volume successfully.
Sep 16 16:31:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9513de48-dc91-4525-9988-d91b702059cb tempest-VolumeAndVolumeTypeFromImageTest-1940913483 None] Lock "cinder-2a7ad68d-32d2-4128-bcb8-d4afeff84b0f-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:30 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7c30abfa-b8b2-46e3-9e46-b1d66c643548 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.278s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:30 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-7c30abfa-b8b2-46e3-9e46-b1d66c643548 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:31:30 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-7c30abfa-b8b2-46e3-9e46-b1d66c643548 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Deleted volume successfully.
Sep 16 16:31:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7c30abfa-b8b2-46e3-9e46-b1d66c643548 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-609f7854-1616-4b45-a7bd-e2b86f3cf68c-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d78fd603-4958-4486-bd8e-bf9da119db00 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "cinder-e5287526-8e68-450d-b6ce-eb748fa5f11f-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d78fd603-4958-4486-bd8e-bf9da119db00 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-e5287526-8e68-450d-b6ce-eb748fa5f11f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cdb3ddb7-ae44-406b-bbe9-8f3bae12b537 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "cinder-bb2211cd-db75-41e1-9c97-443d415dd925-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d78fd603-4958-4486-bd8e-bf9da119db00 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "cinder-quobyte-e5287526-8e68-450d-b6ce-eb748fa5f11f" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cdb3ddb7-ae44-406b-bbe9-8f3bae12b537 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-bb2211cd-db75-41e1-9c97-443d415dd925-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d78fd603-4958-4486-bd8e-bf9da119db00 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-quobyte-e5287526-8e68-450d-b6ce-eb748fa5f11f" acquired by "delete_volume" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:31 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce75267-9f92-4e30-a200-af2dd9ce8f59]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d78fd603-4958-4486-bd8e-bf9da119db00 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e5287526-8e68-450d-b6ce-eb748fa5f11f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cdb3ddb7-ae44-406b-bbe9-8f3bae12b537 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "cinder-quobyte-bb2211cd-db75-41e1-9c97-443d415dd925" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cdb3ddb7-ae44-406b-bbe9-8f3bae12b537 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-quobyte-bb2211cd-db75-41e1-9c97-443d415dd925" acquired by "delete_volume" :: waited 0.031s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:31 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a66816b-113d-463b-8c2d-83e0ecf98a3d]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cdb3ddb7-ae44-406b-bbe9-8f3bae12b537 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bb2211cd-db75-41e1-9c97-443d415dd925 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:31 devstack sudo[106045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e5287526-8e68-450d-b6ce-eb748fa5f11f
Sep 16 16:31:31 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:31 devstack sudo[106046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bb2211cd-db75-41e1-9c97-443d415dd925
Sep 16 16:31:31 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:31 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d78fd603-4958-4486-bd8e-bf9da119db00 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e5287526-8e68-450d-b6ce-eb748fa5f11f" returned: 0 in 0.450s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d78fd603-4958-4486-bd8e-bf9da119db00 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e5287526-8e68-450d-b6ce-eb748fa5f11f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:31 devstack sudo[106054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e5287526-8e68-450d-b6ce-eb748fa5f11f
Sep 16 16:31:31 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:31 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cdb3ddb7-ae44-406b-bbe9-8f3bae12b537 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bb2211cd-db75-41e1-9c97-443d415dd925" returned: 0 in 0.488s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cdb3ddb7-ae44-406b-bbe9-8f3bae12b537 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bb2211cd-db75-41e1-9c97-443d415dd925 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:31 devstack sudo[106058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bb2211cd-db75-41e1-9c97-443d415dd925
Sep 16 16:31:31 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:31 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d78fd603-4958-4486-bd8e-bf9da119db00 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-e5287526-8e68-450d-b6ce-eb748fa5f11f" returned: 0 in 0.325s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d78fd603-4958-4486-bd8e-bf9da119db00 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-quobyte-e5287526-8e68-450d-b6ce-eb748fa5f11f" released by "delete_volume" :: held 0.885s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:31 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-d78fd603-4958-4486-bd8e-bf9da119db00 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Created reservations ['4a6e82fb-4b21-4d22-8507-3716a50496ac', '77eeaaf5-e810-4bac-a33f-030a3500b9dc', '859caee7-2753-48f2-892f-777d1c719d8c', '659efbd4-7f02-40e4-90b6-cb7f3c86ab70'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:31:31 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cdb3ddb7-ae44-406b-bbe9-8f3bae12b537 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bb2211cd-db75-41e1-9c97-443d415dd925" returned: 0 in 0.327s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cdb3ddb7-ae44-406b-bbe9-8f3bae12b537 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-quobyte-bb2211cd-db75-41e1-9c97-443d415dd925" released by "delete_volume" :: held 0.880s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d78fd603-4958-4486-bd8e-bf9da119db00 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d78fd603-4958-4486-bd8e-bf9da119db00 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d78fd603-4958-4486-bd8e-bf9da119db00 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d78fd603-4958-4486-bd8e-bf9da119db00 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d78fd603-4958-4486-bd8e-bf9da119db00 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d78fd603-4958-4486-bd8e-bf9da119db00 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-cdb3ddb7-ae44-406b-bbe9-8f3bae12b537 tempest-CreateVolumesFromSnapshotTest-993043390 None] Created reservations ['012e0833-502e-4c46-83d6-457a97c61b6a', '56cf67e0-7bfb-4993-ad12-f74e9f9784b5', 'cc989db9-c4c5-4256-b610-696f16f5f27c', '45e8519b-caff-4bfa-9e76-52294bae5df4'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:31:32 devstack sudo[106062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:31:32 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d296d65a-8f63-420d-ab53-fe70756cebbc tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "cinder-c570e19d-1c62-4488-a22a-8dce9dbabe96-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d296d65a-8f63-420d-ab53-fe70756cebbc tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-c570e19d-1c62-4488-a22a-8dce9dbabe96-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cdb3ddb7-ae44-406b-bbe9-8f3bae12b537 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cdb3ddb7-ae44-406b-bbe9-8f3bae12b537 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-cdb3ddb7-ae44-406b-bbe9-8f3bae12b537 tempest-CreateVolumesFromSnapshotTest-993043390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-cdb3ddb7-ae44-406b-bbe9-8f3bae12b537 tempest-CreateVolumesFromSnapshotTest-993043390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cdb3ddb7-ae44-406b-bbe9-8f3bae12b537 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cdb3ddb7-ae44-406b-bbe9-8f3bae12b537 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:32 devstack sudo[106064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:31:32 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d296d65a-8f63-420d-ab53-fe70756cebbc tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "cinder-quobyte-c570e19d-1c62-4488-a22a-8dce9dbabe96" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d296d65a-8f63-420d-ab53-fe70756cebbc tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-quobyte-c570e19d-1c62-4488-a22a-8dce9dbabe96" acquired by "delete_volume" :: waited 0.027s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e313e0f-edc4-4bb1-83b8-1df3447d08de]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d296d65a-8f63-420d-ab53-fe70756cebbc tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c570e19d-1c62-4488-a22a-8dce9dbabe96 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:32 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d78fd603-4958-4486-bd8e-bf9da119db00 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.398s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-d78fd603-4958-4486-bd8e-bf9da119db00 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:31:32 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-d78fd603-4958-4486-bd8e-bf9da119db00 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Deleted volume successfully.
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d78fd603-4958-4486-bd8e-bf9da119db00 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-e5287526-8e68-450d-b6ce-eb748fa5f11f-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:32 devstack sudo[106067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c570e19d-1c62-4488-a22a-8dce9dbabe96
Sep 16 16:31:32 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:32 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cdb3ddb7-ae44-406b-bbe9-8f3bae12b537 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.352s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-cdb3ddb7-ae44-406b-bbe9-8f3bae12b537 tempest-CreateVolumesFromSnapshotTest-993043390 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:31:32 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-cdb3ddb7-ae44-406b-bbe9-8f3bae12b537 tempest-CreateVolumesFromSnapshotTest-993043390 None] Deleted volume successfully.
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-cdb3ddb7-ae44-406b-bbe9-8f3bae12b537 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-bb2211cd-db75-41e1-9c97-443d415dd925-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:32 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d296d65a-8f63-420d-ab53-fe70756cebbc tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c570e19d-1c62-4488-a22a-8dce9dbabe96" returned: 0 in 0.509s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d296d65a-8f63-420d-ab53-fe70756cebbc tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c570e19d-1c62-4488-a22a-8dce9dbabe96 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:32 devstack sudo[106073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c570e19d-1c62-4488-a22a-8dce9dbabe96
Sep 16 16:31:32 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:33 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d296d65a-8f63-420d-ab53-fe70756cebbc tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c570e19d-1c62-4488-a22a-8dce9dbabe96" returned: 0 in 0.333s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-60311061-7e6c-4527-a141-f845d821c327 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "cinder-d0a0ea9c-662f-44b8-9879-675f22570ec4-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d296d65a-8f63-420d-ab53-fe70756cebbc tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-quobyte-c570e19d-1c62-4488-a22a-8dce9dbabe96" released by "delete_volume" :: held 0.945s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-60311061-7e6c-4527-a141-f845d821c327 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-d0a0ea9c-662f-44b8-9879-675f22570ec4-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-60311061-7e6c-4527-a141-f845d821c327 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "cinder-quobyte-d0a0ea9c-662f-44b8-9879-675f22570ec4" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:33 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-d296d65a-8f63-420d-ab53-fe70756cebbc tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Created reservations ['c110c241-f5fd-4f5f-92ab-1629dbe4ad2e', 'ee2c85e1-17d2-4d74-af7f-0f7b2c3da0ba', 'f61fa70c-214f-48e4-9add-09e25808705e', '66fb2d35-371e-40c3-b536-ecbc008f346d'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:31:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-60311061-7e6c-4527-a141-f845d821c327 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-quobyte-d0a0ea9c-662f-44b8-9879-675f22570ec4" acquired by "delete_volume" :: waited 0.040s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:33 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea164fa-6774-4808-a78a-4e57f9181ff3]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-60311061-7e6c-4527-a141-f845d821c327 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d0a0ea9c-662f-44b8-9879-675f22570ec4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d296d65a-8f63-420d-ab53-fe70756cebbc tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d296d65a-8f63-420d-ab53-fe70756cebbc tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d296d65a-8f63-420d-ab53-fe70756cebbc tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d296d65a-8f63-420d-ab53-fe70756cebbc tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d296d65a-8f63-420d-ab53-fe70756cebbc tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d296d65a-8f63-420d-ab53-fe70756cebbc tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:33 devstack sudo[106077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:31:33 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:33 devstack sudo[106076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d0a0ea9c-662f-44b8-9879-675f22570ec4
Sep 16 16:31:33 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:33 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d296d65a-8f63-420d-ab53-fe70756cebbc tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.371s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:33 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-d296d65a-8f63-420d-ab53-fe70756cebbc tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:31:33 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-d296d65a-8f63-420d-ab53-fe70756cebbc tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Deleted volume successfully.
Sep 16 16:31:34 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d296d65a-8f63-420d-ab53-fe70756cebbc tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-c570e19d-1c62-4488-a22a-8dce9dbabe96-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-60311061-7e6c-4527-a141-f845d821c327 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d0a0ea9c-662f-44b8-9879-675f22570ec4" returned: 0 in 0.543s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-60311061-7e6c-4527-a141-f845d821c327 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d0a0ea9c-662f-44b8-9879-675f22570ec4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:34 devstack sudo[106085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d0a0ea9c-662f-44b8-9879-675f22570ec4
Sep 16 16:31:34 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:34 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-60311061-7e6c-4527-a141-f845d821c327 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d0a0ea9c-662f-44b8-9879-675f22570ec4" returned: 0 in 0.374s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-60311061-7e6c-4527-a141-f845d821c327 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-quobyte-d0a0ea9c-662f-44b8-9879-675f22570ec4" released by "delete_volume" :: held 1.014s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:34 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-60311061-7e6c-4527-a141-f845d821c327 tempest-CreateVolumesFromSnapshotTest-993043390 None] Created reservations ['d3fa40a0-3bc5-435b-8a30-6a5909063742', '87e6479c-3c19-4c6d-87d1-878d5b3a2680', 'b747d953-8749-43cd-9f85-5efc97130ea2', 'efdfe3d3-96f8-4c3f-956e-27a7d120d55b'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:31:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9c4b6511-c480-4b03-b49a-ebe7e3dd6112 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "cinder-926b59b4-fb4b-41f8-a483-82b2c7998b54-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9c4b6511-c480-4b03-b49a-ebe7e3dd6112 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-926b59b4-fb4b-41f8-a483-82b2c7998b54-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9c4b6511-c480-4b03-b49a-ebe7e3dd6112 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "cinder-quobyte-926b59b4-fb4b-41f8-a483-82b2c7998b54" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9c4b6511-c480-4b03-b49a-ebe7e3dd6112 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-quobyte-926b59b4-fb4b-41f8-a483-82b2c7998b54" acquired by "delete_volume" :: waited 0.030s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-60311061-7e6c-4527-a141-f845d821c327 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-60311061-7e6c-4527-a141-f845d821c327 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-60311061-7e6c-4527-a141-f845d821c327 tempest-CreateVolumesFromSnapshotTest-993043390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-60311061-7e6c-4527-a141-f845d821c327 tempest-CreateVolumesFromSnapshotTest-993043390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-60311061-7e6c-4527-a141-f845d821c327 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-60311061-7e6c-4527-a141-f845d821c327 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:34 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a357872-cbca-4fa5-b5de-6eb2b03bbfa4]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9c4b6511-c480-4b03-b49a-ebe7e3dd6112 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-926b59b4-fb4b-41f8-a483-82b2c7998b54 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:34 devstack sudo[106089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:31:34 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:34 devstack sudo[106090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-926b59b4-fb4b-41f8-a483-82b2c7998b54
Sep 16 16:31:34 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:35 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-60311061-7e6c-4527-a141-f845d821c327 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.360s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:35 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-60311061-7e6c-4527-a141-f845d821c327 tempest-CreateVolumesFromSnapshotTest-993043390 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:31:35 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-60311061-7e6c-4527-a141-f845d821c327 tempest-CreateVolumesFromSnapshotTest-993043390 None] Deleted volume successfully.
Sep 16 16:31:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-60311061-7e6c-4527-a141-f845d821c327 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-d0a0ea9c-662f-44b8-9879-675f22570ec4-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:35 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9c4b6511-c480-4b03-b49a-ebe7e3dd6112 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-926b59b4-fb4b-41f8-a483-82b2c7998b54" returned: 0 in 0.604s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9c4b6511-c480-4b03-b49a-ebe7e3dd6112 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-926b59b4-fb4b-41f8-a483-82b2c7998b54 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:35 devstack sudo[106097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-926b59b4-fb4b-41f8-a483-82b2c7998b54
Sep 16 16:31:35 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-77e33878-40d3-47f9-b55b-5159099ea6b2 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "cinder-430b5b14-1d9e-461f-b844-66f4042de870-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:35 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9c4b6511-c480-4b03-b49a-ebe7e3dd6112 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-926b59b4-fb4b-41f8-a483-82b2c7998b54" returned: 0 in 0.393s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-77e33878-40d3-47f9-b55b-5159099ea6b2 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-430b5b14-1d9e-461f-b844-66f4042de870-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:35 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:31:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Flow 'volume_create_manager' (93f330b8-5b4d-476b-bdd4-c5ac61ac038d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4dc3e8-042c-4b46-8a76-bd56192f92f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9c4b6511-c480-4b03-b49a-ebe7e3dd6112 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-quobyte-926b59b4-fb4b-41f8-a483-82b2c7998b54" released by "delete_volume" :: held 1.131s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4dc3e8-042c-4b46-8a76-bd56192f92f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a92b27-656a-4268-935a-c3ae1be818dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a493e7814b4988b4aefacd17867240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:36Z,use_quota=True,user_id='baeb116e9c9b487e9390ad73c7cb4568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1458fe2-3839-4879-960a-ce005c0322f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1458fe2-3839-4879-960a-ce005c0322f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3f6f62-3dc9-4d55-a461-a519e75dfcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:35 devstack cinder-volume[86165]: DEBUG cinder.image.glance [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Creating Keystone auth plugin from conf {{(pid=86165) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 16 16:31:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-77e33878-40d3-47f9-b55b-5159099ea6b2 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "cinder-quobyte-430b5b14-1d9e-461f-b844-66f4042de870" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-77e33878-40d3-47f9-b55b-5159099ea6b2 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-quobyte-430b5b14-1d9e-461f-b844-66f4042de870" acquired by "delete_volume" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:35 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8f4c64-a0ff-45d0-b864-21797bbcf37e]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-77e33878-40d3-47f9-b55b-5159099ea6b2 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-430b5b14-1d9e-461f-b844-66f4042de870 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:35 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-9c4b6511-c480-4b03-b49a-ebe7e3dd6112 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Created reservations ['146e84ad-2210-45c9-8424-5d9a49d120a2', '5ab0d6a6-062e-41c5-9fe6-ed8fbc65d448', 'f4b4f42b-dcb8-4ccd-8c53-89687eb14257', 'a472910f-9334-4006-b12d-d0dc54faacea'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9c4b6511-c480-4b03-b49a-ebe7e3dd6112 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9c4b6511-c480-4b03-b49a-ebe7e3dd6112 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9c4b6511-c480-4b03-b49a-ebe7e3dd6112 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9c4b6511-c480-4b03-b49a-ebe7e3dd6112 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9c4b6511-c480-4b03-b49a-ebe7e3dd6112 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9c4b6511-c480-4b03-b49a-ebe7e3dd6112 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:36 devstack sudo[106101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:31:36 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:36 devstack sudo[106100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-430b5b14-1d9e-461f-b844-66f4042de870
Sep 16 16:31:36 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3f6f62-3dc9-4d55-a461-a519e75dfcec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd1a92b27-656a-4268-935a-c3ae1be818dc', 'volume_name': 'volume-d1a92b27-656a-4268-935a-c3ae1be818dc', 'volume_size': 1, 'image_id': '060847d9-6e48-4a4f-975e-6ada8335f59e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/060847d9-6e48-4a4f-975e-6ada8335f59e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7bd1a46e2e6d4eea48e62b20aaac3c6e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a8a493e7814b4988b4aefacd17867240', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8083052e520dec35123e63c36a63b8a6e4b4ff404b675d0c49c9a78405868a622e6dc03c24afc8cd027f13235b2f0dc1378e6360a2bdd31a06890aa567835144', 'id': '060847d9-6e48-4a4f-975e-6ada8335f59e', 'created_at': datetime.datetime(2026, 9, 16, 14, 31, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 31, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/060847d9-6e48-4a4f-975e-6ada8335f59e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e4c03db80>}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63119ccf-e70d-4aa8-92fd-71f7f8798918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63119ccf-e70d-4aa8-92fd-71f7f8798918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f8c0d7-03c8-4674-806b-6c00630e9a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:36 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Volume d1a92b27-656a-4268-935a-c3ae1be818dc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d1a92b27-656a-4268-935a-c3ae1be818dc', 'volume_size': 1, 'image_id': '060847d9-6e48-4a4f-975e-6ada8335f59e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/060847d9-6e48-4a4f-975e-6ada8335f59e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7bd1a46e2e6d4eea48e62b20aaac3c6e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a8a493e7814b4988b4aefacd17867240', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8083052e520dec35123e63c36a63b8a6e4b4ff404b675d0c49c9a78405868a622e6dc03c24afc8cd027f13235b2f0dc1378e6360a2bdd31a06890aa567835144', 'id': '060847d9-6e48-4a4f-975e-6ada8335f59e', 'created_at': datetime.datetime(2026, 9, 16, 14, 31, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 31, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/060847d9-6e48-4a4f-975e-6ada8335f59e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e4c03db80>}
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Trying to clone d1a92b27-656a-4268-935a-c3ae1be818dc from image 060847d9-6e48-4a4f-975e-6ada8335f59e at location (None, [{'url': 'file:///opt/stack/data/glance/images/060847d9-6e48-4a4f-975e-6ada8335f59e', 'metadata': {}}]). {{(pid=86165) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 16 16:31:36 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9c4b6511-c480-4b03-b49a-ebe7e3dd6112 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.329s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-9c4b6511-c480-4b03-b49a-ebe7e3dd6112 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:31:36 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-9c4b6511-c480-4b03-b49a-ebe7e3dd6112 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Deleted volume successfully.
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9c4b6511-c480-4b03-b49a-ebe7e3dd6112 tempest-CreateVolumesFromSourceVolumeTest-1368896912 None] Lock "cinder-926b59b4-fb4b-41f8-a483-82b2c7998b54-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 16 16:31:36 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Image download 0.00 MB at 0.00 MB/s
Sep 16 16:31:36 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-77e33878-40d3-47f9-b55b-5159099ea6b2 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-430b5b14-1d9e-461f-b844-66f4042de870" returned: 0 in 0.514s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-77e33878-40d3-47f9-b55b-5159099ea6b2 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-430b5b14-1d9e-461f-b844-66f4042de870 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:36 devstack sudo[106108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-430b5b14-1d9e-461f-b844-66f4042de870
Sep 16 16:31:36 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d258c110-0659-4929-ae34-1d972c2484e0]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:36 devstack sudo[106110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD
Sep 16 16:31:36 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:36 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-77e33878-40d3-47f9-b55b-5159099ea6b2 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-430b5b14-1d9e-461f-b844-66f4042de870" returned: 0 in 0.305s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-77e33878-40d3-47f9-b55b-5159099ea6b2 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-quobyte-430b5b14-1d9e-461f-b844-66f4042de870" released by "delete_volume" :: held 0.897s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-77e33878-40d3-47f9-b55b-5159099ea6b2 tempest-CreateVolumesFromSnapshotTest-993043390 None] Created reservations ['baca28d3-96bd-4b32-a367-4b756f40e503', '8915a24b-d595-4c0a-914d-a28c44aa9596', '69e58a68-df17-4e2c-9e9d-aa548761026e', 'e5a471de-d508-44ab-8657-cd8d27841efa'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:31:36 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD" returned: 0 in 0.421s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Flow 'volume_create_manager' (19f90b58-e4e8-4c13-90f6-251ad3a67c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9fce720-df7f-4220-a19d-4b99172dcfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9fce720-df7f-4220-a19d-4b99172dcfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2081172244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d344c67-0b77-4f03-8223-4b3dbbc0dc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c91e72efced4cbe964a43dc831761c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:37Z,use_quota=True,user_id='19d033dec351495da6e8bdf2409d3e0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05adb7f2-6e5b-4b64-a314-0c763bf9f7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05adb7f2-6e5b-4b64-a314-0c763bf9f7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640925c9-062c-434a-8ab7-64a0596aa591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (640925c9-062c-434a-8ab7-64a0596aa591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d344c67-0b77-4f03-8223-4b3dbbc0dc9d', 'volume_name': 'volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:37 devstack sudo[106115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD
Sep 16 16:31:37 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa3e2ee-ddea-4ab6-8c15-22450c0dc774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa3e2ee-ddea-4ab6-8c15-22450c0dc774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47906854-5f87-47c5-acf9-d0274443e516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:37 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Volume 3d344c67-0b77-4f03-8223-4b3dbbc0dc9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d', 'volume_size': 1}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2081172244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d344c67-0b77-4f03-8223-4b3dbbc0dc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c91e72efced4cbe964a43dc831761c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:37Z,use_quota=True,user_id='19d033dec351495da6e8bdf2409d3e0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Creating volume 3d344c67-0b77-4f03-8223-4b3dbbc0dc9d {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:31:37 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-77e33878-40d3-47f9-b55b-5159099ea6b2 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-77e33878-40d3-47f9-b55b-5159099ea6b2 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-77e33878-40d3-47f9-b55b-5159099ea6b2 tempest-CreateVolumesFromSnapshotTest-993043390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-77e33878-40d3-47f9-b55b-5159099ea6b2 tempest-CreateVolumesFromSnapshotTest-993043390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-77e33878-40d3-47f9-b55b-5159099ea6b2 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-77e33878-40d3-47f9-b55b-5159099ea6b2 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:37 devstack sudo[106118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d 1073741824
Sep 16 16:31:37 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:37 devstack sudo[106119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:31:37 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:37 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD" returned: 1 in 0.420s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Temporary image 060847d9-6e48-4a4f-975e-6ada8335f59e is fetched for user baeb116e9c9b487e9390ad73c7cb4568. {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe8f15e-4835-40a5-84e9-6c364d5bfb89]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:37 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-77e33878-40d3-47f9-b55b-5159099ea6b2 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.328s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-77e33878-40d3-47f9-b55b-5159099ea6b2 tempest-CreateVolumesFromSnapshotTest-993043390 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:31:37 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-77e33878-40d3-47f9-b55b-5159099ea6b2 tempest-CreateVolumesFromSnapshotTest-993043390 None] Deleted volume successfully.
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-77e33878-40d3-47f9-b55b-5159099ea6b2 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-430b5b14-1d9e-461f-b844-66f4042de870-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:37 devstack sudo[106129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD
Sep 16 16:31:37 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:37 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d 1073741824" returned: 0 in 0.591s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:37 devstack sudo[106132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d
Sep 16 16:31:37 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:37 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD" returned: 0 in 0.420s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:38 devstack sudo[106136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD
Sep 16 16:31:38 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b7e102bb-bd47-4ae5-9fc0-54b64dcf90c8 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "cinder-3775f27d-53f0-4c2d-9e0a-409a8802b974-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:38 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b7e102bb-bd47-4ae5-9fc0-54b64dcf90c8 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-3775f27d-53f0-4c2d-9e0a-409a8802b974-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d" returned: 0 in 0.352s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47906854-5f87-47c5-acf9-d0274443e516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78473bb9-0079-483d-96f9-47b044ac1256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:38 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Volume volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d (3d344c67-0b77-4f03-8223-4b3dbbc0dc9d): created successfully
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78473bb9-0079-483d-96f9-47b044ac1256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Flow 'volume_create_manager' (19f90b58-e4e8-4c13-90f6-251ad3a67c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b7e102bb-bd47-4ae5-9fc0-54b64dcf90c8 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "cinder-quobyte-3775f27d-53f0-4c2d-9e0a-409a8802b974" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:38 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-d41c21c5-52cf-4863-8670-8a36d102618e tempest-VolumeDependencyTests-953854334 None] Created volume successfully.
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b7e102bb-bd47-4ae5-9fc0-54b64dcf90c8 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-quobyte-3775f27d-53f0-4c2d-9e0a-409a8802b974" acquired by "delete_volume" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[de76138d-21dc-4905-bf23-9081adb7ca16]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b7e102bb-bd47-4ae5-9fc0-54b64dcf90c8 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3775f27d-53f0-4c2d-9e0a-409a8802b974 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:38 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD" returned: 1 in 0.453s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a92b27-656a-4268-935a-c3ae1be818dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a493e7814b4988b4aefacd17867240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:36Z,use_quota=True,user_id='baeb116e9c9b487e9390ad73c7cb4568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Creating volume d1a92b27-656a-4268-935a-c3ae1be818dc {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:31:38 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d1a92b27-656a-4268-935a-c3ae1be818dc 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:38 devstack sudo[106143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d1a92b27-656a-4268-935a-c3ae1be818dc 1073741824
Sep 16 16:31:38 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:38 devstack sudo[106139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3775f27d-53f0-4c2d-9e0a-409a8802b974
Sep 16 16:31:38 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:38 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b7e102bb-bd47-4ae5-9fc0-54b64dcf90c8 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3775f27d-53f0-4c2d-9e0a-409a8802b974" returned: 0 in 0.409s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b7e102bb-bd47-4ae5-9fc0-54b64dcf90c8 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3775f27d-53f0-4c2d-9e0a-409a8802b974 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:38 devstack sudo[106152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3775f27d-53f0-4c2d-9e0a-409a8802b974
Sep 16 16:31:38 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:38 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d1a92b27-656a-4268-935a-c3ae1be818dc 1073741824" returned: 0 in 0.570s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:38 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d1a92b27-656a-4268-935a-c3ae1be818dc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b7e102bb-bd47-4ae5-9fc0-54b64dcf90c8 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3775f27d-53f0-4c2d-9e0a-409a8802b974" returned: 0 in 0.344s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:39 devstack sudo[106156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d1a92b27-656a-4268-935a-c3ae1be818dc
Sep 16 16:31:39 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b7e102bb-bd47-4ae5-9fc0-54b64dcf90c8 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-quobyte-3775f27d-53f0-4c2d-9e0a-409a8802b974" released by "delete_volume" :: held 0.825s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-b7e102bb-bd47-4ae5-9fc0-54b64dcf90c8 tempest-CreateVolumesFromSnapshotTest-993043390 None] Created reservations ['1d22b459-6eb2-4781-a56c-27114f3c3d7e', '071ef859-04ec-4e7c-9e7b-83a671dc2b96', '2251b66b-0e2f-4f18-b7e2-e5aa47d4ea85', 'cd3e29ca-38e9-4c89-9bf1-f064a3903dc5'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b7e102bb-bd47-4ae5-9fc0-54b64dcf90c8 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b7e102bb-bd47-4ae5-9fc0-54b64dcf90c8 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b7e102bb-bd47-4ae5-9fc0-54b64dcf90c8 tempest-CreateVolumesFromSnapshotTest-993043390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b7e102bb-bd47-4ae5-9fc0-54b64dcf90c8 tempest-CreateVolumesFromSnapshotTest-993043390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b7e102bb-bd47-4ae5-9fc0-54b64dcf90c8 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b7e102bb-bd47-4ae5-9fc0-54b64dcf90c8 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b86938d5-4194-46c5-8d51-81081bd5d109 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "cinder-fea78372-0e08-4330-9cdb-ac8cbf5676a2-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:39 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d1a92b27-656a-4268-935a-c3ae1be818dc" returned: 0 in 0.351s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:39 devstack sudo[106159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:31:39 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b86938d5-4194-46c5-8d51-81081bd5d109 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-fea78372-0e08-4330-9cdb-ac8cbf5676a2-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-85287cc7-bc50-4a29-bbf1-20351a54bfe7 tempest-VolumeDependencyTests-953854334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-85287cc7-bc50-4a29-bbf1-20351a54bfe7 tempest-VolumeDependencyTests-953854334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Attempting download of 060847d9-6e48-4a4f-975e-6ada8335f59e ((None, [{'url': 'file:///opt/stack/data/glance/images/060847d9-6e48-4a4f-975e-6ada8335f59e', 'metadata': {}}])) to volume d1a92b27-656a-4268-935a-c3ae1be818dc. {{(pid=86165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-85287cc7-bc50-4a29-bbf1-20351a54bfe7 tempest-VolumeDependencyTests-953854334 None] Creating offline snapshot 2ec9dd13-f64a-4357-802a-2cac5445d655 of volume 3d344c67-0b77-4f03-8223-4b3dbbc0dc9d {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b86938d5-4194-46c5-8d51-81081bd5d109 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "cinder-quobyte-fea78372-0e08-4330-9cdb-ac8cbf5676a2" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa4e1b4-ac5a-497b-9f78-3507f76eb400]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-85287cc7-bc50-4a29-bbf1-20351a54bfe7 tempest-VolumeDependencyTests-953854334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[978cfd91-74f4-4bb5-a691-886eeae15952]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_060847d9-6e48-4a4f-975e-6ada8335f59e_i5evpvfr {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b86938d5-4194-46c5-8d51-81081bd5d109 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-quobyte-fea78372-0e08-4330-9cdb-ac8cbf5676a2" acquired by "delete_volume" :: waited 0.049s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ce4d11-4dca-4e3e-b501-7cab9d9b08f8]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b86938d5-4194-46c5-8d51-81081bd5d109 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fea78372-0e08-4330-9cdb-ac8cbf5676a2 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:39 devstack sudo[106163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d
Sep 16 16:31:39 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:39 devstack sudo[106164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_060847d9-6e48-4a4f-975e-6ada8335f59e_i5evpvfr
Sep 16 16:31:39 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:39 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b7e102bb-bd47-4ae5-9fc0-54b64dcf90c8 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.388s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-b7e102bb-bd47-4ae5-9fc0-54b64dcf90c8 tempest-CreateVolumesFromSnapshotTest-993043390 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:31:39 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b7e102bb-bd47-4ae5-9fc0-54b64dcf90c8 tempest-CreateVolumesFromSnapshotTest-993043390 None] Deleted volume successfully.
Sep 16 16:31:39 devstack sudo[106165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fea78372-0e08-4330-9cdb-ac8cbf5676a2
Sep 16 16:31:39 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b7e102bb-bd47-4ae5-9fc0-54b64dcf90c8 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-3775f27d-53f0-4c2d-9e0a-409a8802b974-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:39 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_060847d9-6e48-4a4f-975e-6ada8335f59e_i5evpvfr" returned: 0 in 0.438s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_060847d9-6e48-4a4f-975e-6ada8335f59e_i5evpvfr {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:40 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-85287cc7-bc50-4a29-bbf1-20351a54bfe7 tempest-VolumeDependencyTests-953854334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d" returned: 0 in 0.522s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-85287cc7-bc50-4a29-bbf1-20351a54bfe7 tempest-VolumeDependencyTests-953854334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:40 devstack sudo[106178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655 1G
Sep 16 16:31:40 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:40 devstack sudo[106175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_060847d9-6e48-4a4f-975e-6ada8335f59e_i5evpvfr
Sep 16 16:31:40 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:40 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b86938d5-4194-46c5-8d51-81081bd5d109 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fea78372-0e08-4330-9cdb-ac8cbf5676a2" returned: 0 in 0.552s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b86938d5-4194-46c5-8d51-81081bd5d109 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fea78372-0e08-4330-9cdb-ac8cbf5676a2 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:40 devstack sudo[106182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fea78372-0e08-4330-9cdb-ac8cbf5676a2
Sep 16 16:31:40 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:40 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_060847d9-6e48-4a4f-975e-6ada8335f59e_i5evpvfr" returned: 1 in 0.388s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_060847d9-6e48-4a4f-975e-6ada8335f59e_i5evpvfr' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:31:40 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaf4e53-0a07-4649-8d1d-087dbd86a6b6]: (4, 'raw') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:40 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b86938d5-4194-46c5-8d51-81081bd5d109 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-fea78372-0e08-4330-9cdb-ac8cbf5676a2" returned: 0 in 0.385s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:40 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b86938d5-4194-46c5-8d51-81081bd5d109 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-quobyte-fea78372-0e08-4330-9cdb-ac8cbf5676a2" released by "delete_volume" :: held 0.998s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:40 devstack sudo[106190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD
Sep 16 16:31:40 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:40 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-85287cc7-bc50-4a29-bbf1-20351a54bfe7 tempest-VolumeDependencyTests-953854334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655 1G" returned: 0 in 0.561s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-85287cc7-bc50-4a29-bbf1-20351a54bfe7 tempest-VolumeDependencyTests-953854334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:40 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-b86938d5-4194-46c5-8d51-81081bd5d109 tempest-CreateVolumesFromSnapshotTest-993043390 None] Created reservations ['8e322eab-14d4-430e-8103-b531a604ccd1', 'e93e5b2a-142c-4195-a0d1-573de236d8b5', 'd53de86a-6f57-4220-9a67-f369ad22eeee', '6db0a520-e62f-495d-9fff-a2c282461f92'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:31:40 devstack sudo[106193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655
Sep 16 16:31:40 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b86938d5-4194-46c5-8d51-81081bd5d109 tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b86938d5-4194-46c5-8d51-81081bd5d109 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b86938d5-4194-46c5-8d51-81081bd5d109 tempest-CreateVolumesFromSnapshotTest-993043390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b86938d5-4194-46c5-8d51-81081bd5d109 tempest-CreateVolumesFromSnapshotTest-993043390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b86938d5-4194-46c5-8d51-81081bd5d109 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b86938d5-4194-46c5-8d51-81081bd5d109 tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:40 devstack sudo[106195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:31:40 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:40 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD" returned: 0 in 0.510s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:40 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-85287cc7-bc50-4a29-bbf1-20351a54bfe7 tempest-VolumeDependencyTests-953854334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655" returned: 0 in 0.432s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:41 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:41 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-85287cc7-bc50-4a29-bbf1-20351a54bfe7 tempest-VolumeDependencyTests-953854334 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655 is being set with open permissions: ugo+rw
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-85287cc7-bc50-4a29-bbf1-20351a54bfe7 tempest-VolumeDependencyTests-953854334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:41 devstack sudo[106201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD
Sep 16 16:31:41 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b86938d5-4194-46c5-8d51-81081bd5d109 tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.294s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-b86938d5-4194-46c5-8d51-81081bd5d109 tempest-CreateVolumesFromSnapshotTest-993043390 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:31:41 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b86938d5-4194-46c5-8d51-81081bd5d109 tempest-CreateVolumesFromSnapshotTest-993043390 None] Deleted volume successfully.
Sep 16 16:31:41 devstack sudo[106206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655
Sep 16 16:31:41 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b86938d5-4194-46c5-8d51-81081bd5d109 tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-fea78372-0e08-4330-9cdb-ac8cbf5676a2-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-f88cbfd9-6bdd-41c3-a0b1-e097ec6e0b3a tempest-ProjectAdminTests-1234518483 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.9149932861328, 'free_capacity_gb': 1775.9149932861328, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86165) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 16 16:31:41 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD" returned: 1 in 0.396s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] 060847d9-6e48-4a4f-975e-6ada8335f59e was raw, converting to qcow2 {{(pid=86165) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d1a92b27-656a-4268-935a-c3ae1be818dc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:41 devstack sudo[106211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d1a92b27-656a-4268-935a-c3ae1be818dc
Sep 16 16:31:41 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:41 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-85287cc7-bc50-4a29-bbf1-20351a54bfe7 tempest-VolumeDependencyTests-953854334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655" returned: 0 in 0.316s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-85287cc7-bc50-4a29-bbf1-20351a54bfe7 tempest-VolumeDependencyTests-953854334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:41 devstack sudo[106214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.info
Sep 16 16:31:41 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b8b6e4f6-7031-45b7-8708-32285ce4295c tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "cinder-ffdc6816-ad52-4afb-9ebd-3b95163bf73f-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b8b6e4f6-7031-45b7-8708-32285ce4295c tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-ffdc6816-ad52-4afb-9ebd-3b95163bf73f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b8b6e4f6-7031-45b7-8708-32285ce4295c tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "cinder-quobyte-bc6988d6-8ae4-40f6-aff7-0246f04a7c00" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b8b6e4f6-7031-45b7-8708-32285ce4295c tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-quobyte-bc6988d6-8ae4-40f6-aff7-0246f04a7c00" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b8b6e4f6-7031-45b7-8708-32285ce4295c tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "cinder-quobyte-ffdc6816-ad52-4afb-9ebd-3b95163bf73f" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b8b6e4f6-7031-45b7-8708-32285ce4295c tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-quobyte-ffdc6816-ad52-4afb-9ebd-3b95163bf73f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-b8b6e4f6-7031-45b7-8708-32285ce4295c tempest-CreateVolumesFromSnapshotTest-993043390 None] Deleting offline snapshot ffdc6816-ad52-4afb-9ebd-3b95163bf73f of volume bc6988d6-8ae4-40f6-aff7-0246f04a7c00 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:31:41 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-b8b6e4f6-7031-45b7-8708-32285ce4295c tempest-CreateVolumesFromSnapshotTest-993043390 None] snapshot_file for this snap is: volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.ffdc6816-ad52-4afb-9ebd-3b95163bf73f {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-85287cc7-bc50-4a29-bbf1-20351a54bfe7 tempest-VolumeDependencyTests-953854334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.info" returned: 0 in 0.353s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:41 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-85287cc7-bc50-4a29-bbf1-20351a54bfe7 tempest-VolumeDependencyTests-953854334 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.info is being set with open permissions: ugo+rw
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-85287cc7-bc50-4a29-bbf1-20351a54bfe7 tempest-VolumeDependencyTests-953854334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b371a07-6f6e-4f42-9566-4d137822c6d2]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b8b6e4f6-7031-45b7-8708-32285ce4295c tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.ffdc6816-ad52-4afb-9ebd-3b95163bf73f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:41 devstack sudo[106221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.info
Sep 16 16:31:41 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:41 devstack sudo[106222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.ffdc6816-ad52-4afb-9ebd-3b95163bf73f
Sep 16 16:31:41 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:41 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d1a92b27-656a-4268-935a-c3ae1be818dc" returned: 0 in 0.614s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_060847d9-6e48-4a4f-975e-6ada8335f59e_zhuwipm2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d1a92b27-656a-4268-935a-c3ae1be818dc {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:31:41 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Converted 0.00 MB image at 0.00 MB/s
Sep 16 16:31:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d1a92b27-656a-4268-935a-c3ae1be818dc 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:41 devstack sudo[106225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d1a92b27-656a-4268-935a-c3ae1be818dc 1G
Sep 16 16:31:41 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:42 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-85287cc7-bc50-4a29-bbf1-20351a54bfe7 tempest-VolumeDependencyTests-953854334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.info" returned: 0 in 0.352s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-85287cc7-bc50-4a29-bbf1-20351a54bfe7 tempest-VolumeDependencyTests-953854334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.680s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:42 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-85287cc7-bc50-4a29-bbf1-20351a54bfe7 tempest-VolumeDependencyTests-953854334 None] Create snapshot completed successfully
Sep 16 16:31:42 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b8b6e4f6-7031-45b7-8708-32285ce4295c tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.ffdc6816-ad52-4afb-9ebd-3b95163bf73f" returned: 0 in 0.460s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:42 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-b8b6e4f6-7031-45b7-8708-32285ce4295c tempest-CreateVolumesFromSnapshotTest-993043390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:31:42 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e416aa3e-4412-4f5e-8231-7addb1b3496b]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b8b6e4f6-7031-45b7-8708-32285ce4295c tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:42 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d1a92b27-656a-4268-935a-c3ae1be818dc 1G" returned: 0 in 0.447s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:42 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Downloaded image 060847d9-6e48-4a4f-975e-6ada8335f59e ((None, [{'url': 'file:///opt/stack/data/glance/images/060847d9-6e48-4a4f-975e-6ada8335f59e', 'metadata': {}}])) to volume d1a92b27-656a-4268-935a-c3ae1be818dc successfully. {{(pid=86165) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 16 16:31:42 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Temporary image 060847d9-6e48-4a4f-975e-6ada8335f59e for user baeb116e9c9b487e9390ad73c7cb4568 is deleted. {{(pid=86165) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 16 16:31:42 devstack cinder-volume[86165]: DEBUG cinder.volume.volume_utils [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Marking volume d1a92b27-656a-4268-935a-c3ae1be818dc as bootable. {{(pid=86165) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 16 16:31:42 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Copying metadata from image 060847d9-6e48-4a4f-975e-6ada8335f59e to d1a92b27-656a-4268-935a-c3ae1be818dc. {{(pid=86165) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 16:31:42 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Creating volume glance metadata for volume d1a92b27-656a-4268-935a-c3ae1be818dc backed by image 060847d9-6e48-4a4f-975e-6ada8335f59e with: {'image_id': '060847d9-6e48-4a4f-975e-6ada8335f59e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7bd1a46e2e6d4eea48e62b20aaac3c6e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86165) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 16:31:42 devstack sudo[106235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00
Sep 16 16:31:42 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f8c0d7-03c8-4674-806b-6c00630e9a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1a92b27-656a-4268-935a-c3ae1be818dc', 'volume_size': 1, 'image_id': '060847d9-6e48-4a4f-975e-6ada8335f59e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/060847d9-6e48-4a4f-975e-6ada8335f59e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7bd1a46e2e6d4eea48e62b20aaac3c6e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a8a493e7814b4988b4aefacd17867240', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8083052e520dec35123e63c36a63b8a6e4b4ff404b675d0c49c9a78405868a622e6dc03c24afc8cd027f13235b2f0dc1378e6360a2bdd31a06890aa567835144', 'id': '060847d9-6e48-4a4f-975e-6ada8335f59e', 'created_at': datetime.datetime(2026, 9, 16, 14, 31, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 31, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/060847d9-6e48-4a4f-975e-6ada8335f59e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7b2e4c03db80>}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fac809f-69f7-4e28-af63-4ade4d2968a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:42 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Volume volume-d1a92b27-656a-4268-935a-c3ae1be818dc (d1a92b27-656a-4268-935a-c3ae1be818dc): created successfully
Sep 16 16:31:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fac809f-69f7-4e28-af63-4ade4d2968a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Flow 'volume_create_manager' (93f330b8-5b4d-476b-bdd4-c5ac61ac038d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:42 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-1d5388af-59ec-4d85-815b-43bb4f60a59d tempest-VolumeImageDependencyTests-226876340 None] Created volume successfully.
Sep 16 16:31:42 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b8b6e4f6-7031-45b7-8708-32285ce4295c tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00" returned: 0 in 0.522s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b8b6e4f6-7031-45b7-8708-32285ce4295c tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.ffdc6816-ad52-4afb-9ebd-3b95163bf73f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:42 devstack sudo[106240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.ffdc6816-ad52-4afb-9ebd-3b95163bf73f
Sep 16 16:31:42 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:43 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b8b6e4f6-7031-45b7-8708-32285ce4295c tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.ffdc6816-ad52-4afb-9ebd-3b95163bf73f" returned: 0 in 0.506s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b8b6e4f6-7031-45b7-8708-32285ce4295c tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.ffdc6816-ad52-4afb-9ebd-3b95163bf73f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:43 devstack sudo[106246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.ffdc6816-ad52-4afb-9ebd-3b95163bf73f
Sep 16 16:31:43 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-68dcf391-5ec1-493b-b150-ad2492df56fc tempest-VolumeImageDependencyTests-226876340 None] Acquiring lock "cinder-d1a92b27-656a-4268-935a-c3ae1be818dc-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Flow 'volume_create_manager' (c2463098-a1aa-4ae5-b557-75664200cfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2357bcda-3cbd-4e72-b9ed-2cfb1e2809cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-68dcf391-5ec1-493b-b150-ad2492df56fc tempest-VolumeImageDependencyTests-226876340 None] Lock "cinder-d1a92b27-656a-4268-935a-c3ae1be818dc-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2357bcda-3cbd-4e72-b9ed-2cfb1e2809cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-884588314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c04e066c-76f4-44cc-899a-278b2e324196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c91e72efced4cbe964a43dc831761c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2ec9dd13-f64a-4357-802a-2cac5445d655,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:43Z,use_quota=True,user_id='19d033dec351495da6e8bdf2409d3e0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418a8b5d-5ee9-4b7b-80af-8c1079fb9449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418a8b5d-5ee9-4b7b-80af-8c1079fb9449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca390758-021c-48ad-b3c5-8afca3e77780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca390758-021c-48ad-b3c5-8afca3e77780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c04e066c-76f4-44cc-899a-278b2e324196', 'volume_name': 'volume-c04e066c-76f4-44cc-899a-278b2e324196', 'volume_size': 1, 'snapshot_id': '2ec9dd13-f64a-4357-802a-2cac5445d655'}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d814bef-d62e-4fa3-a87c-5fa468338103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d814bef-d62e-4fa3-a87c-5fa468338103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f0afc60-4b51-4ba9-b6b3-76f260ca703a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:43 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Volume c04e066c-76f4-44cc-899a-278b2e324196: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c04e066c-76f4-44cc-899a-278b2e324196', 'volume_size': 1, 'snapshot_id': '2ec9dd13-f64a-4357-802a-2cac5445d655'}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Acquiring lock "cinder-quobyte-2ec9dd13-f64a-4357-802a-2cac5445d655-c04e066c-76f4-44cc-899a-278b2e324196" by "_create_volume_from_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-68dcf391-5ec1-493b-b150-ad2492df56fc tempest-VolumeImageDependencyTests-226876340 None] Acquiring lock "cinder-quobyte-d1a92b27-656a-4268-935a-c3ae1be818dc" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Lock "cinder-quobyte-2ec9dd13-f64a-4357-802a-2cac5445d655-c04e066c-76f4-44cc-899a-278b2e324196" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Creating volume c04e066c-76f4-44cc-899a-278b2e324196 from snapshot 2ec9dd13-f64a-4357-802a-2cac5445d655 {{(pid=86165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Acquiring lock "cinder-quobyte-c04e066c-76f4-44cc-899a-278b2e324196" by "_copy_volume_from_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-68dcf391-5ec1-493b-b150-ad2492df56fc tempest-VolumeImageDependencyTests-226876340 None] Lock "cinder-quobyte-d1a92b27-656a-4268-935a-c3ae1be818dc" acquired by "delete_volume" :: waited 0.030s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Lock "cinder-quobyte-c04e066c-76f4-44cc-899a-278b2e324196" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] snapshot: 2ec9dd13-f64a-4357-802a-2cac5445d655, volume: c04e066c-76f4-44cc-899a-278b2e324196,  {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 16:31:43 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbd90e0-3b05-4557-815f-88b3c8dde874]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-68dcf391-5ec1-493b-b150-ad2492df56fc tempest-VolumeImageDependencyTests-226876340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d1a92b27-656a-4268-935a-c3ae1be818dc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b8b6e4f6-7031-45b7-8708-32285ce4295c tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00.ffdc6816-ad52-4afb-9ebd-3b95163bf73f" returned: 0 in 0.361s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[608cf0d0-9d9b-4483-9cdc-eedfceee7959]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b8b6e4f6-7031-45b7-8708-32285ce4295c tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-quobyte-ffdc6816-ad52-4afb-9ebd-3b95163bf73f" released by "_delete_snapshot" :: held 2.041s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b8b6e4f6-7031-45b7-8708-32285ce4295c tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-quobyte-bc6988d6-8ae4-40f6-aff7-0246f04a7c00" released by "delete_snapshot" :: held 2.069s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:43 devstack sudo[106249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d1a92b27-656a-4268-935a-c3ae1be818dc
Sep 16 16:31:43 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:43 devstack sudo[106250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655
Sep 16 16:31:43 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-b8b6e4f6-7031-45b7-8708-32285ce4295c tempest-CreateVolumesFromSnapshotTest-993043390 None] Created reservations ['5ae8861f-222b-48a5-95af-b6f5ab8d10c9', '36bb2bff-c5eb-4361-b024-b2c0c6977fb9', '159c6737-717a-4ad9-a107-14619812be85', '861a3f6c-9c46-4748-91a0-3cf96827d9b8'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:31:43 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b8b6e4f6-7031-45b7-8708-32285ce4295c tempest-CreateVolumesFromSnapshotTest-993043390 None] Delete snapshot completed successfully.
Sep 16 16:31:43 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b8b6e4f6-7031-45b7-8708-32285ce4295c tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-ffdc6816-ad52-4afb-9ebd-3b95163bf73f-delete_snapshot" released by "delete_snapshot" :: held 2.320s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:44 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655" returned: 0 in 0.473s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:31:44 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-68dcf391-5ec1-493b-b150-ad2492df56fc tempest-VolumeImageDependencyTests-226876340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d1a92b27-656a-4268-935a-c3ae1be818dc" returned: 0 in 0.508s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-68dcf391-5ec1-493b-b150-ad2492df56fc tempest-VolumeImageDependencyTests-226876340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d1a92b27-656a-4268-935a-c3ae1be818dc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfa7949-fd77-4fe1-98ef-f9541b82ae8c]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:44 devstack sudo[106259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d1a92b27-656a-4268-935a-c3ae1be818dc
Sep 16 16:31:44 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:44 devstack sudo[106261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d
Sep 16 16:31:44 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:44 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-68dcf391-5ec1-493b-b150-ad2492df56fc tempest-VolumeImageDependencyTests-226876340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-d1a92b27-656a-4268-935a-c3ae1be818dc" returned: 0 in 0.282s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-68dcf391-5ec1-493b-b150-ad2492df56fc tempest-VolumeImageDependencyTests-226876340 None] Lock "cinder-quobyte-d1a92b27-656a-4268-935a-c3ae1be818dc" released by "delete_volume" :: held 0.889s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-68dcf391-5ec1-493b-b150-ad2492df56fc tempest-VolumeImageDependencyTests-226876340 None] Created reservations ['20bdc1d9-b9b6-4a77-8eb2-f23eb6f9141e', '539a52ed-9210-4239-9d1e-3ffb92c25f3a', '0b8812fd-4f59-4521-a259-f4696535b3bb', '453861cb-2770-49a0-a7a3-559caa6510ef'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-68dcf391-5ec1-493b-b150-ad2492df56fc tempest-VolumeImageDependencyTests-226876340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-68dcf391-5ec1-493b-b150-ad2492df56fc tempest-VolumeImageDependencyTests-226876340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-68dcf391-5ec1-493b-b150-ad2492df56fc tempest-VolumeImageDependencyTests-226876340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-68dcf391-5ec1-493b-b150-ad2492df56fc tempest-VolumeImageDependencyTests-226876340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-68dcf391-5ec1-493b-b150-ad2492df56fc tempest-VolumeImageDependencyTests-226876340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-68dcf391-5ec1-493b-b150-ad2492df56fc tempest-VolumeImageDependencyTests-226876340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:44 devstack sudo[106267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:31:44 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:44 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d" returned: 0 in 0.509s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] will copy from snapshot at /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Creating direct copy from snapshot {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG cinder.utils [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Path /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c04e066c-76f4-44cc-899a-278b2e324196 not found in is_blk_device check {{(pid=86165) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c04e066c-76f4-44cc-899a-278b2e324196 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:44 devstack sudo[106269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c04e066c-76f4-44cc-899a-278b2e324196
Sep 16 16:31:44 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:44 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7eb44c19-d9ef-47f4-bfbc-fb4d43f9721c tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "cinder-bc6988d6-8ae4-40f6-aff7-0246f04a7c00-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-68dcf391-5ec1-493b-b150-ad2492df56fc tempest-VolumeImageDependencyTests-226876340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.349s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-68dcf391-5ec1-493b-b150-ad2492df56fc tempest-VolumeImageDependencyTests-226876340 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:31:44 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-68dcf391-5ec1-493b-b150-ad2492df56fc tempest-VolumeImageDependencyTests-226876340 None] Deleted volume successfully.
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7eb44c19-d9ef-47f4-bfbc-fb4d43f9721c tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-bc6988d6-8ae4-40f6-aff7-0246f04a7c00-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:44 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-68dcf391-5ec1-493b-b150-ad2492df56fc tempest-VolumeImageDependencyTests-226876340 None] Lock "cinder-d1a92b27-656a-4268-935a-c3ae1be818dc-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:45 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7eb44c19-d9ef-47f4-bfbc-fb4d43f9721c tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "cinder-quobyte-bc6988d6-8ae4-40f6-aff7-0246f04a7c00" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:45 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7eb44c19-d9ef-47f4-bfbc-fb4d43f9721c tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-quobyte-bc6988d6-8ae4-40f6-aff7-0246f04a7c00" acquired by "delete_volume" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:45 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de4cf4c-6774-4cde-bf63-76ff45e05d69]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7eb44c19-d9ef-47f4-bfbc-fb4d43f9721c tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:45 devstack sudo[106276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00
Sep 16 16:31:45 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:45 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7eb44c19-d9ef-47f4-bfbc-fb4d43f9721c tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00" returned: 0 in 0.723s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7eb44c19-d9ef-47f4-bfbc-fb4d43f9721c tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:45 devstack sudo[106287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00
Sep 16 16:31:45 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:46 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7eb44c19-d9ef-47f4-bfbc-fb4d43f9721c tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc6988d6-8ae4-40f6-aff7-0246f04a7c00" returned: 0 in 0.538s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:46 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7eb44c19-d9ef-47f4-bfbc-fb4d43f9721c tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-quobyte-bc6988d6-8ae4-40f6-aff7-0246f04a7c00" released by "delete_volume" :: held 1.373s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:46 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-7eb44c19-d9ef-47f4-bfbc-fb4d43f9721c tempest-CreateVolumesFromSnapshotTest-993043390 None] Created reservations ['5edbcf48-466c-43e2-bae2-85fed41a246f', 'ba507653-0277-4237-b4d6-77ff4da38f4d', '5e75f007-735a-4adf-891c-91d1dbbd6743', '89e784b3-3496-420f-aa8d-a8a1de6bba3f'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:31:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7eb44c19-d9ef-47f4-bfbc-fb4d43f9721c tempest-CreateVolumesFromSnapshotTest-993043390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7eb44c19-d9ef-47f4-bfbc-fb4d43f9721c tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:46 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7eb44c19-d9ef-47f4-bfbc-fb4d43f9721c tempest-CreateVolumesFromSnapshotTest-993043390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:46 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7eb44c19-d9ef-47f4-bfbc-fb4d43f9721c tempest-CreateVolumesFromSnapshotTest-993043390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7eb44c19-d9ef-47f4-bfbc-fb4d43f9721c tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7eb44c19-d9ef-47f4-bfbc-fb4d43f9721c tempest-CreateVolumesFromSnapshotTest-993043390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:46 devstack sudo[106290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:31:46 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:47 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7eb44c19-d9ef-47f4-bfbc-fb4d43f9721c tempest-CreateVolumesFromSnapshotTest-993043390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.562s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:47 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-7eb44c19-d9ef-47f4-bfbc-fb4d43f9721c tempest-CreateVolumesFromSnapshotTest-993043390 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:31:47 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-7eb44c19-d9ef-47f4-bfbc-fb4d43f9721c tempest-CreateVolumesFromSnapshotTest-993043390 None] Deleted volume successfully.
Sep 16 16:31:47 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7eb44c19-d9ef-47f4-bfbc-fb4d43f9721c tempest-CreateVolumesFromSnapshotTest-993043390 None] Lock "cinder-bc6988d6-8ae4-40f6-aff7-0246f04a7c00-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:53 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c04e066c-76f4-44cc-899a-278b2e324196" returned: 0 in 9.063s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:53 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Image conversion details: src /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d, size 1024.00 MB, duration 9.06 sec, destination /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c04e066c-76f4-44cc-899a-278b2e324196 {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:31:53 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Converted 1024.00 MB image at 112.98 MB/s
Sep 16 16:31:53 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c04e066c-76f4-44cc-899a-278b2e324196 is being set with open permissions: ugo+rw
Sep 16 16:31:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c04e066c-76f4-44cc-899a-278b2e324196 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:53 devstack sudo[106295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c04e066c-76f4-44cc-899a-278b2e324196
Sep 16 16:31:53 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:53 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c04e066c-76f4-44cc-899a-278b2e324196" returned: 0 in 0.281s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Lock "cinder-quobyte-c04e066c-76f4-44cc-899a-278b2e324196" released by "_copy_volume_from_snapshot" :: held 10.452s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Lock "cinder-quobyte-2ec9dd13-f64a-4357-802a-2cac5445d655-c04e066c-76f4-44cc-899a-278b2e324196" released by "_create_volume_from_snapshot" :: held 10.551s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.583s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f0afc60-4b51-4ba9-b6b3-76f260ca703a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c04e066c-76f4-44cc-899a-278b2e324196', 'volume_size': 1, 'snapshot_id': '2ec9dd13-f64a-4357-802a-2cac5445d655'}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4e8904-c4f4-496c-b78f-316bd2034bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:54 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Volume volume-c04e066c-76f4-44cc-899a-278b2e324196 (c04e066c-76f4-44cc-899a-278b2e324196): created successfully
Sep 16 16:31:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4e8904-c4f4-496c-b78f-316bd2034bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:54 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Flow 'volume_create_manager' (c2463098-a1aa-4ae5-b557-75664200cfde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:54 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-2ad2cd20-7850-43e1-91a4-c673de6a2bbf tempest-VolumeDependencyTests-953854334 None] Created volume successfully.
Sep 16 16:31:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bd0ce17b-74cd-49b1-9081-00af7b994cd6 tempest-VolumeDependencyTests-953854334 None] Acquiring lock "cinder-2ec9dd13-f64a-4357-802a-2cac5445d655-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bd0ce17b-74cd-49b1-9081-00af7b994cd6 tempest-VolumeDependencyTests-953854334 None] Lock "cinder-2ec9dd13-f64a-4357-802a-2cac5445d655-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bd0ce17b-74cd-49b1-9081-00af7b994cd6 tempest-VolumeDependencyTests-953854334 None] Acquiring lock "cinder-quobyte-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bd0ce17b-74cd-49b1-9081-00af7b994cd6 tempest-VolumeDependencyTests-953854334 None] Lock "cinder-quobyte-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bd0ce17b-74cd-49b1-9081-00af7b994cd6 tempest-VolumeDependencyTests-953854334 None] Acquiring lock "cinder-quobyte-2ec9dd13-f64a-4357-802a-2cac5445d655" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bd0ce17b-74cd-49b1-9081-00af7b994cd6 tempest-VolumeDependencyTests-953854334 None] Lock "cinder-quobyte-2ec9dd13-f64a-4357-802a-2cac5445d655" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-bd0ce17b-74cd-49b1-9081-00af7b994cd6 tempest-VolumeDependencyTests-953854334 None] Deleting offline snapshot 2ec9dd13-f64a-4357-802a-2cac5445d655 of volume 3d344c67-0b77-4f03-8223-4b3dbbc0dc9d {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:31:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-bd0ce17b-74cd-49b1-9081-00af7b994cd6 tempest-VolumeDependencyTests-953854334 None] snapshot_file for this snap is: volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:31:54 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[86267e24-28dc-4746-9180-27a1b18b1baf]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bd0ce17b-74cd-49b1-9081-00af7b994cd6 tempest-VolumeDependencyTests-953854334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:54 devstack sudo[106298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655
Sep 16 16:31:54 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:54 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bd0ce17b-74cd-49b1-9081-00af7b994cd6 tempest-VolumeDependencyTests-953854334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655" returned: 0 in 0.448s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-bd0ce17b-74cd-49b1-9081-00af7b994cd6 tempest-VolumeDependencyTests-953854334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:31:55 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a22b7b-9fc8-4a57-afe1-e5d6fdf4aced]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bd0ce17b-74cd-49b1-9081-00af7b994cd6 tempest-VolumeDependencyTests-953854334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:55 devstack sudo[106304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d
Sep 16 16:31:55 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:55 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bd0ce17b-74cd-49b1-9081-00af7b994cd6 tempest-VolumeDependencyTests-953854334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d" returned: 0 in 0.703s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bd0ce17b-74cd-49b1-9081-00af7b994cd6 tempest-VolumeDependencyTests-953854334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:55 devstack sudo[106309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655
Sep 16 16:31:55 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:55 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:31:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Flow 'volume_create_manager' (25501896-4ac4-4334-8e8b-cfbf33a007ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b495bd-52de-439f-8700-89220cb94ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b495bd-52de-439f-8700-89220cb94ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1917058988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd012fc-ced6-4caa-851d-3d09d001ac22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4be84013f847d4a2f15dde740a2536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:56Z,use_quota=True,user_id='ae825737116546298fd942e8502abe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:55 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e05ffcb-8249-4cf2-a1c4-a3eca1a75f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e05ffcb-8249-4cf2-a1c4-a3eca1a75f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4dcf742-1218-4715-becd-f783010c0ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4dcf742-1218-4715-becd-f783010c0ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cd012fc-ced6-4caa-851d-3d09d001ac22', 'volume_name': 'volume-0cd012fc-ced6-4caa-851d-3d09d001ac22', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5bf0a5-c879-4122-9947-baa2e05a9809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5bf0a5-c879-4122-9947-baa2e05a9809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e350f7-3d72-4417-848d-e39eda866446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:56 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Volume 0cd012fc-ced6-4caa-851d-3d09d001ac22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cd012fc-ced6-4caa-851d-3d09d001ac22', 'volume_size': 1}
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1917058988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd012fc-ced6-4caa-851d-3d09d001ac22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4be84013f847d4a2f15dde740a2536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:56Z,use_quota=True,user_id='ae825737116546298fd942e8502abe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Creating volume 0cd012fc-ced6-4caa-851d-3d09d001ac22 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:31:56 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:56 devstack sudo[106311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22 1073741824
Sep 16 16:31:56 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:56 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bd0ce17b-74cd-49b1-9081-00af7b994cd6 tempest-VolumeDependencyTests-953854334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655" returned: 0 in 0.554s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bd0ce17b-74cd-49b1-9081-00af7b994cd6 tempest-VolumeDependencyTests-953854334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:56 devstack sudo[106317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655
Sep 16 16:31:56 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:56 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bd0ce17b-74cd-49b1-9081-00af7b994cd6 tempest-VolumeDependencyTests-953854334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d.2ec9dd13-f64a-4357-802a-2cac5445d655" returned: 0 in 0.337s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:56 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bd0ce17b-74cd-49b1-9081-00af7b994cd6 tempest-VolumeDependencyTests-953854334 None] Lock "cinder-quobyte-2ec9dd13-f64a-4357-802a-2cac5445d655" released by "_delete_snapshot" :: held 2.197s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22 1073741824" returned: 0 in 0.625s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bd0ce17b-74cd-49b1-9081-00af7b994cd6 tempest-VolumeDependencyTests-953854334 None] Lock "cinder-quobyte-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d" released by "delete_snapshot" :: held 2.229s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:56 devstack sudo[106324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22
Sep 16 16:31:56 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-bd0ce17b-74cd-49b1-9081-00af7b994cd6 tempest-VolumeDependencyTests-953854334 None] Created reservations ['d4cc28e7-a8df-4bc0-9739-10a448538454', '57be6640-4e9e-4ad5-b660-2ada1d632604', 'c97e3aef-6a03-4a41-81b9-11cda86d7323', '04b0a54e-deed-404b-a83c-8ac4c090c481'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:31:56 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-bd0ce17b-74cd-49b1-9081-00af7b994cd6 tempest-VolumeDependencyTests-953854334 None] Delete snapshot completed successfully.
Sep 16 16:31:56 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bd0ce17b-74cd-49b1-9081-00af7b994cd6 tempest-VolumeDependencyTests-953854334 None] Lock "cinder-2ec9dd13-f64a-4357-802a-2cac5445d655-delete_snapshot" released by "delete_snapshot" :: held 2.523s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:57 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22" returned: 0 in 0.377s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:57 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:31:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e350f7-3d72-4417-848d-e39eda866446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cd012fc-ced6-4caa-851d-3d09d001ac22', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acdbfcaf-e7f0-4446-bbc8-3a5f19720642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:31:57 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Volume volume-0cd012fc-ced6-4caa-851d-3d09d001ac22 (0cd012fc-ced6-4caa-851d-3d09d001ac22): created successfully
Sep 16 16:31:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acdbfcaf-e7f0-4446-bbc8-3a5f19720642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:31:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Flow 'volume_create_manager' (25501896-4ac4-4334-8e8b-cfbf33a007ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:31:57 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-cd08c38a-67e0-4e74-b137-51d7602b5d28 tempest-ProjectMemberTests-864664885 None] Created volume successfully.
Sep 16 16:31:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-989a2829-5050-44cf-bbe1-39f237280428 tempest-VolumeDependencyTests-953854334 None] Acquiring lock "cinder-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-989a2829-5050-44cf-bbe1-39f237280428 tempest-VolumeDependencyTests-953854334 None] Lock "cinder-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-989a2829-5050-44cf-bbe1-39f237280428 tempest-VolumeDependencyTests-953854334 None] Acquiring lock "cinder-quobyte-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:31:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-989a2829-5050-44cf-bbe1-39f237280428 tempest-VolumeDependencyTests-953854334 None] Lock "cinder-quobyte-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d" acquired by "delete_volume" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:31:57 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f608169-b09a-4e98-a3a4-5918a89ac300]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-989a2829-5050-44cf-bbe1-39f237280428 tempest-VolumeDependencyTests-953854334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:58 devstack sudo[106327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d
Sep 16 16:31:58 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:58 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-989a2829-5050-44cf-bbe1-39f237280428 tempest-VolumeDependencyTests-953854334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d" returned: 0 in 0.582s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-989a2829-5050-44cf-bbe1-39f237280428 tempest-VolumeDependencyTests-953854334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:58 devstack sudo[106332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d
Sep 16 16:31:58 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2c363389-f572-4cf5-81a3-04b3f682ab0d tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2c363389-f572-4cf5-81a3-04b3f682ab0d tempest-ProjectMemberTests-864664885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:58 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-2c363389-f572-4cf5-81a3-04b3f682ab0d tempest-ProjectMemberTests-864664885 None] Creating offline snapshot 5e296f01-81c1-4db9-89f7-f5aca1d2e883 of volume 0cd012fc-ced6-4caa-851d-3d09d001ac22 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:31:58 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[180effe9-5399-4b67-8160-8c274462dcbd]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:31:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c363389-f572-4cf5-81a3-04b3f682ab0d tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:58 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-989a2829-5050-44cf-bbe1-39f237280428 tempest-VolumeDependencyTests-953854334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d" returned: 0 in 0.431s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:58 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-989a2829-5050-44cf-bbe1-39f237280428 tempest-VolumeDependencyTests-953854334 None] Lock "cinder-quobyte-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d" released by "delete_volume" :: held 1.125s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:31:59 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-989a2829-5050-44cf-bbe1-39f237280428 tempest-VolumeDependencyTests-953854334 None] Created reservations ['038ce4be-70db-49cd-b6b0-3b0d4b2a82c3', '4cce4355-43cd-428f-99eb-546891abcadd', 'c9c0cf8b-7429-4c35-8bc0-69c49ca61077', '1d2fe837-d6d5-4197-a226-bc9a26233a8e'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:31:59 devstack sudo[106335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22
Sep 16 16:31:59 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-989a2829-5050-44cf-bbe1-39f237280428 tempest-VolumeDependencyTests-953854334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:31:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-989a2829-5050-44cf-bbe1-39f237280428 tempest-VolumeDependencyTests-953854334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:31:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-989a2829-5050-44cf-bbe1-39f237280428 tempest-VolumeDependencyTests-953854334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:31:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-989a2829-5050-44cf-bbe1-39f237280428 tempest-VolumeDependencyTests-953854334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:31:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-989a2829-5050-44cf-bbe1-39f237280428 tempest-VolumeDependencyTests-953854334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:31:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-989a2829-5050-44cf-bbe1-39f237280428 tempest-VolumeDependencyTests-953854334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:59 devstack sudo[106337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:31:59 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:59 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c363389-f572-4cf5-81a3-04b3f682ab0d tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22" returned: 0 in 0.503s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c363389-f572-4cf5-81a3-04b3f682ab0d tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.5e296f01-81c1-4db9-89f7-f5aca1d2e883 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:31:59 devstack sudo[106343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.5e296f01-81c1-4db9-89f7-f5aca1d2e883 1G
Sep 16 16:31:59 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:31:59 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root
Sep 16 16:31:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-989a2829-5050-44cf-bbe1-39f237280428 tempest-VolumeDependencyTests-953854334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.336s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:31:59 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-989a2829-5050-44cf-bbe1-39f237280428 tempest-VolumeDependencyTests-953854334 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:31:59 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-989a2829-5050-44cf-bbe1-39f237280428 tempest-VolumeDependencyTests-953854334 None] Deleted volume successfully.
Sep 16 16:31:59 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-989a2829-5050-44cf-bbe1-39f237280428 tempest-VolumeDependencyTests-953854334 None] Lock "cinder-3d344c67-0b77-4f03-8223-4b3dbbc0dc9d-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:00 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c363389-f572-4cf5-81a3-04b3f682ab0d tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.5e296f01-81c1-4db9-89f7-f5aca1d2e883 1G" returned: 0 in 0.626s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c363389-f572-4cf5-81a3-04b3f682ab0d tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cd012fc-ced6-4caa-851d-3d09d001ac22 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.5e296f01-81c1-4db9-89f7-f5aca1d2e883 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:00 devstack sudo[106349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cd012fc-ced6-4caa-851d-3d09d001ac22 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.5e296f01-81c1-4db9-89f7-f5aca1d2e883
Sep 16 16:32:00 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f00463d1-6d3d-4967-8fb6-a196c0b6fe48 tempest-VolumeDependencyTests-953854334 None] Acquiring lock "cinder-c04e066c-76f4-44cc-899a-278b2e324196-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f00463d1-6d3d-4967-8fb6-a196c0b6fe48 tempest-VolumeDependencyTests-953854334 None] Lock "cinder-c04e066c-76f4-44cc-899a-278b2e324196-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f00463d1-6d3d-4967-8fb6-a196c0b6fe48 tempest-VolumeDependencyTests-953854334 None] Acquiring lock "cinder-quobyte-c04e066c-76f4-44cc-899a-278b2e324196" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:00 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f00463d1-6d3d-4967-8fb6-a196c0b6fe48 tempest-VolumeDependencyTests-953854334 None] Lock "cinder-quobyte-c04e066c-76f4-44cc-899a-278b2e324196" acquired by "delete_volume" :: waited 0.015s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:00 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[12490f4d-559e-45ca-9dc7-92f269547655]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f00463d1-6d3d-4967-8fb6-a196c0b6fe48 tempest-VolumeDependencyTests-953854334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c04e066c-76f4-44cc-899a-278b2e324196 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:00 devstack sudo[106351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c04e066c-76f4-44cc-899a-278b2e324196
Sep 16 16:32:00 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:00 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c363389-f572-4cf5-81a3-04b3f682ab0d tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cd012fc-ced6-4caa-851d-3d09d001ac22 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.5e296f01-81c1-4db9-89f7-f5aca1d2e883" returned: 0 in 0.463s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:00 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-2c363389-f572-4cf5-81a3-04b3f682ab0d tempest-ProjectMemberTests-864664885 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.5e296f01-81c1-4db9-89f7-f5aca1d2e883 is being set with open permissions: ugo+rw
Sep 16 16:32:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c363389-f572-4cf5-81a3-04b3f682ab0d tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.5e296f01-81c1-4db9-89f7-f5aca1d2e883 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:00 devstack sudo[106357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.5e296f01-81c1-4db9-89f7-f5aca1d2e883
Sep 16 16:32:00 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:00 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f00463d1-6d3d-4967-8fb6-a196c0b6fe48 tempest-VolumeDependencyTests-953854334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c04e066c-76f4-44cc-899a-278b2e324196" returned: 0 in 0.450s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f00463d1-6d3d-4967-8fb6-a196c0b6fe48 tempest-VolumeDependencyTests-953854334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c04e066c-76f4-44cc-899a-278b2e324196 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:00 devstack sudo[106363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c04e066c-76f4-44cc-899a-278b2e324196
Sep 16 16:32:00 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:00 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c363389-f572-4cf5-81a3-04b3f682ab0d tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.5e296f01-81c1-4db9-89f7-f5aca1d2e883" returned: 0 in 0.351s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c363389-f572-4cf5-81a3-04b3f682ab0d tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:00 devstack sudo[106366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.info
Sep 16 16:32:00 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:01 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f00463d1-6d3d-4967-8fb6-a196c0b6fe48 tempest-VolumeDependencyTests-953854334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-c04e066c-76f4-44cc-899a-278b2e324196" returned: 0 in 0.357s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:01 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f00463d1-6d3d-4967-8fb6-a196c0b6fe48 tempest-VolumeDependencyTests-953854334 None] Lock "cinder-quobyte-c04e066c-76f4-44cc-899a-278b2e324196" released by "delete_volume" :: held 0.879s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:01 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-f00463d1-6d3d-4967-8fb6-a196c0b6fe48 tempest-VolumeDependencyTests-953854334 None] Created reservations ['0cc7c0e9-a4ff-4b87-b539-ad1eb5b02228', '78fe54b6-6e24-4f7c-99cb-bbf7595c6868', 'a18e108e-222a-4213-91fd-b37050415ee2', '08aa0a9c-80b7-42af-80f4-3b79033a0430'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f00463d1-6d3d-4967-8fb6-a196c0b6fe48 tempest-VolumeDependencyTests-953854334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f00463d1-6d3d-4967-8fb6-a196c0b6fe48 tempest-VolumeDependencyTests-953854334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:01 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-f00463d1-6d3d-4967-8fb6-a196c0b6fe48 tempest-VolumeDependencyTests-953854334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:01 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-f00463d1-6d3d-4967-8fb6-a196c0b6fe48 tempest-VolumeDependencyTests-953854334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-f00463d1-6d3d-4967-8fb6-a196c0b6fe48 tempest-VolumeDependencyTests-953854334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:01 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f00463d1-6d3d-4967-8fb6-a196c0b6fe48 tempest-VolumeDependencyTests-953854334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c363389-f572-4cf5-81a3-04b3f682ab0d tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.info" returned: 0 in 0.405s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:01 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-2c363389-f572-4cf5-81a3-04b3f682ab0d tempest-ProjectMemberTests-864664885 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.info is being set with open permissions: ugo+rw
Sep 16 16:32:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c363389-f572-4cf5-81a3-04b3f682ab0d tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:01 devstack sudo[106371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:32:01 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:01 devstack sudo[106372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.info
Sep 16 16:32:01 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:01 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-f00463d1-6d3d-4967-8fb6-a196c0b6fe48 tempest-VolumeDependencyTests-953854334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.473s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:01 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-f00463d1-6d3d-4967-8fb6-a196c0b6fe48 tempest-VolumeDependencyTests-953854334 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:32:01 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-f00463d1-6d3d-4967-8fb6-a196c0b6fe48 tempest-VolumeDependencyTests-953854334 None] Deleted volume successfully.
Sep 16 16:32:01 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c363389-f572-4cf5-81a3-04b3f682ab0d tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.info" returned: 0 in 0.495s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2c363389-f572-4cf5-81a3-04b3f682ab0d tempest-ProjectMemberTests-864664885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.018s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:01 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-f00463d1-6d3d-4967-8fb6-a196c0b6fe48 tempest-VolumeDependencyTests-953854334 None] Lock "cinder-c04e066c-76f4-44cc-899a-278b2e324196-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:01 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-2c363389-f572-4cf5-81a3-04b3f682ab0d tempest-ProjectMemberTests-864664885 None] Create snapshot completed successfully
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Flow 'volume_create_manager' (7b20f3df-680c-4e02-ae4d-e28006cd7845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (032647c9-ef2a-42d6-965a-54f5108553a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0d05d4a3-4bf8-4248-b430-4e04567d21d2 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-5e296f01-81c1-4db9-89f7-f5aca1d2e883-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (032647c9-ef2a-42d6-965a-54f5108553a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1381661506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a24bbce-8dba-4b86-96be-e79cc7aaa012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2081234a0841ebb70dd376a2636466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:02Z,use_quota=True,user_id='6dd42f1fbabe4a4bbc5462522d3bcf8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb896ec-e853-41d7-90f9-47d9d0f9200e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb896ec-e853-41d7-90f9-47d9d0f9200e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3cc53ab-16df-4993-aedd-adc6d27bb803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3cc53ab-16df-4993-aedd-adc6d27bb803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a24bbce-8dba-4b86-96be-e79cc7aaa012', 'volume_name': 'volume-4a24bbce-8dba-4b86-96be-e79cc7aaa012', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9c0bc5-cde1-41f9-8ba2-274472b2dea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9c0bc5-cde1-41f9-8ba2-274472b2dea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e721195d-03eb-4929-9f62-9cc1c0fb44ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:02 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Volume 4a24bbce-8dba-4b86-96be-e79cc7aaa012: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a24bbce-8dba-4b86-96be-e79cc7aaa012', 'volume_size': 1}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1381661506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a24bbce-8dba-4b86-96be-e79cc7aaa012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2081234a0841ebb70dd376a2636466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:02Z,use_quota=True,user_id='6dd42f1fbabe4a4bbc5462522d3bcf8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Creating volume 4a24bbce-8dba-4b86-96be-e79cc7aaa012 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:32:02 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4a24bbce-8dba-4b86-96be-e79cc7aaa012 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0d05d4a3-4bf8-4248-b430-4e04567d21d2 tempest-ProjectMemberTests-864664885 None] Lock "cinder-5e296f01-81c1-4db9-89f7-f5aca1d2e883-delete_snapshot" acquired by "delete_snapshot" :: waited 0.104s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0d05d4a3-4bf8-4248-b430-4e04567d21d2 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-0cd012fc-ced6-4caa-851d-3d09d001ac22" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:02 devstack sudo[106378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4a24bbce-8dba-4b86-96be-e79cc7aaa012 1073741824
Sep 16 16:32:02 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0d05d4a3-4bf8-4248-b430-4e04567d21d2 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-0cd012fc-ced6-4caa-851d-3d09d001ac22" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0d05d4a3-4bf8-4248-b430-4e04567d21d2 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-5e296f01-81c1-4db9-89f7-f5aca1d2e883" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0d05d4a3-4bf8-4248-b430-4e04567d21d2 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-5e296f01-81c1-4db9-89f7-f5aca1d2e883" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-0d05d4a3-4bf8-4248-b430-4e04567d21d2 tempest-ProjectMemberTests-864664885 None] Deleting offline snapshot 5e296f01-81c1-4db9-89f7-f5aca1d2e883 of volume 0cd012fc-ced6-4caa-851d-3d09d001ac22 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-0d05d4a3-4bf8-4248-b430-4e04567d21d2 tempest-ProjectMemberTests-864664885 None] snapshot_file for this snap is: volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.5e296f01-81c1-4db9-89f7-f5aca1d2e883 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdbbf44-9eb8-451e-80ce-411b843e223c]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0d05d4a3-4bf8-4248-b430-4e04567d21d2 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.5e296f01-81c1-4db9-89f7-f5aca1d2e883 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:02 devstack sudo[106380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.5e296f01-81c1-4db9-89f7-f5aca1d2e883
Sep 16 16:32:02 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:02 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0d05d4a3-4bf8-4248-b430-4e04567d21d2 tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.5e296f01-81c1-4db9-89f7-f5aca1d2e883" returned: 0 in 0.578s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-0d05d4a3-4bf8-4248-b430-4e04567d21d2 tempest-ProjectMemberTests-864664885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cd012fc-ced6-4caa-851d-3d09d001ac22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:32:02 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4a24bbce-8dba-4b86-96be-e79cc7aaa012 1073741824" returned: 0 in 0.743s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2828b9f1-e7ab-425c-8c17-d67eca793fcc]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0d05d4a3-4bf8-4248-b430-4e04567d21d2 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4a24bbce-8dba-4b86-96be-e79cc7aaa012 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:03 devstack sudo[106390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4a24bbce-8dba-4b86-96be-e79cc7aaa012
Sep 16 16:32:03 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:03 devstack sudo[106389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22
Sep 16 16:32:03 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:03 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4a24bbce-8dba-4b86-96be-e79cc7aaa012" returned: 0 in 0.349s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:03 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:32:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:03 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e721195d-03eb-4929-9f62-9cc1c0fb44ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a24bbce-8dba-4b86-96be-e79cc7aaa012', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:03 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93ea623-0a26-428a-8c11-44fb462a786f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:03 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Volume volume-4a24bbce-8dba-4b86-96be-e79cc7aaa012 (4a24bbce-8dba-4b86-96be-e79cc7aaa012): created successfully
Sep 16 16:32:03 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93ea623-0a26-428a-8c11-44fb462a786f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:03 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Flow 'volume_create_manager' (7b20f3df-680c-4e02-ae4d-e28006cd7845) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:03 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0d05d4a3-4bf8-4248-b430-4e04567d21d2 tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22" returned: 0 in 0.505s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0d05d4a3-4bf8-4248-b430-4e04567d21d2 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.5e296f01-81c1-4db9-89f7-f5aca1d2e883 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:03 devstack sudo[106397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.5e296f01-81c1-4db9-89f7-f5aca1d2e883
Sep 16 16:32:03 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:03 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-6d7009d4-8088-42d3-911b-cd6e33055bde tempest-ProjectReaderTests-294031119 None] Created volume successfully.
Sep 16 16:32:03 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0d05d4a3-4bf8-4248-b430-4e04567d21d2 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.5e296f01-81c1-4db9-89f7-f5aca1d2e883" returned: 0 in 0.429s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0d05d4a3-4bf8-4248-b430-4e04567d21d2 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.5e296f01-81c1-4db9-89f7-f5aca1d2e883 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:03 devstack sudo[106403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.5e296f01-81c1-4db9-89f7-f5aca1d2e883
Sep 16 16:32:03 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:04 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0d05d4a3-4bf8-4248-b430-4e04567d21d2 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22.5e296f01-81c1-4db9-89f7-f5aca1d2e883" returned: 0 in 0.376s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0d05d4a3-4bf8-4248-b430-4e04567d21d2 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-5e296f01-81c1-4db9-89f7-f5aca1d2e883" released by "_delete_snapshot" :: held 2.111s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0d05d4a3-4bf8-4248-b430-4e04567d21d2 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-0cd012fc-ced6-4caa-851d-3d09d001ac22" released by "delete_snapshot" :: held 2.145s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:04 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-0d05d4a3-4bf8-4248-b430-4e04567d21d2 tempest-ProjectMemberTests-864664885 None] Created reservations ['93b6905c-3d95-41aa-a46c-3f5500511966', '02f4e41b-9a14-472d-8463-a6a5ed1f1ce7', '58d3300a-9fdf-4ec9-bb1e-3d7d6e1b13fe', 'ddd41e11-749c-4eec-a160-6f24b2b78741'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-611c92c0-34d2-4b0f-b128-a03b964f4b11 tempest-ProjectReaderTests-294031119 None] Acquiring lock "cinder-4a24bbce-8dba-4b86-96be-e79cc7aaa012-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:04 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-0d05d4a3-4bf8-4248-b430-4e04567d21d2 tempest-ProjectMemberTests-864664885 None] Delete snapshot completed successfully.
Sep 16 16:32:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0d05d4a3-4bf8-4248-b430-4e04567d21d2 tempest-ProjectMemberTests-864664885 None] Lock "cinder-5e296f01-81c1-4db9-89f7-f5aca1d2e883-delete_snapshot" released by "delete_snapshot" :: held 2.390s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-611c92c0-34d2-4b0f-b128-a03b964f4b11 tempest-ProjectReaderTests-294031119 None] Lock "cinder-4a24bbce-8dba-4b86-96be-e79cc7aaa012-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-611c92c0-34d2-4b0f-b128-a03b964f4b11 tempest-ProjectReaderTests-294031119 None] Acquiring lock "cinder-quobyte-4a24bbce-8dba-4b86-96be-e79cc7aaa012" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-611c92c0-34d2-4b0f-b128-a03b964f4b11 tempest-ProjectReaderTests-294031119 None] Lock "cinder-quobyte-4a24bbce-8dba-4b86-96be-e79cc7aaa012" acquired by "delete_volume" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:04 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec98d41-0fef-40ce-92eb-b7812fd70a01]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-611c92c0-34d2-4b0f-b128-a03b964f4b11 tempest-ProjectReaderTests-294031119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4a24bbce-8dba-4b86-96be-e79cc7aaa012 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:04 devstack sudo[106406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4a24bbce-8dba-4b86-96be-e79cc7aaa012
Sep 16 16:32:04 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:05 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-611c92c0-34d2-4b0f-b128-a03b964f4b11 tempest-ProjectReaderTests-294031119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4a24bbce-8dba-4b86-96be-e79cc7aaa012" returned: 0 in 0.445s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-611c92c0-34d2-4b0f-b128-a03b964f4b11 tempest-ProjectReaderTests-294031119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4a24bbce-8dba-4b86-96be-e79cc7aaa012 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:05 devstack sudo[106411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4a24bbce-8dba-4b86-96be-e79cc7aaa012
Sep 16 16:32:05 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-16c4e490-e875-4e2b-9847-e2435908c379 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-0cd012fc-ced6-4caa-851d-3d09d001ac22-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-16c4e490-e875-4e2b-9847-e2435908c379 tempest-ProjectMemberTests-864664885 None] Lock "cinder-0cd012fc-ced6-4caa-851d-3d09d001ac22-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-16c4e490-e875-4e2b-9847-e2435908c379 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-0cd012fc-ced6-4caa-851d-3d09d001ac22" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-16c4e490-e875-4e2b-9847-e2435908c379 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-0cd012fc-ced6-4caa-851d-3d09d001ac22" acquired by "delete_volume" :: waited 0.022s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:05 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-611c92c0-34d2-4b0f-b128-a03b964f4b11 tempest-ProjectReaderTests-294031119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-4a24bbce-8dba-4b86-96be-e79cc7aaa012" returned: 0 in 0.350s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-611c92c0-34d2-4b0f-b128-a03b964f4b11 tempest-ProjectReaderTests-294031119 None] Lock "cinder-quobyte-4a24bbce-8dba-4b86-96be-e79cc7aaa012" released by "delete_volume" :: held 0.849s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:05 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[553cd284-51fc-49fb-abfb-321362a06461]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-16c4e490-e875-4e2b-9847-e2435908c379 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:05 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:SELECT=186,cinder:UPDATE=274,cinder:DELETE=23,cinder:INSERT=73 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:32:05 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-611c92c0-34d2-4b0f-b128-a03b964f4b11 tempest-ProjectReaderTests-294031119 None] Created reservations ['27011634-afc5-46cf-b5dd-b7721814bf17', 'b5210bfa-7c77-4a24-bd2b-deaf3c85edd7', '0cf26645-5b5c-4c8b-b98c-177e119f9722', '7c6477f1-d2ac-413c-a600-8ed1cb0a012f'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:05 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=252,cinder:SELECT=205,cinder:INSERT=72,cinder:DELETE=24 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:32:05 devstack sudo[106414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22
Sep 16 16:32:05 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-611c92c0-34d2-4b0f-b128-a03b964f4b11 tempest-ProjectReaderTests-294031119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-611c92c0-34d2-4b0f-b128-a03b964f4b11 tempest-ProjectReaderTests-294031119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-611c92c0-34d2-4b0f-b128-a03b964f4b11 tempest-ProjectReaderTests-294031119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-611c92c0-34d2-4b0f-b128-a03b964f4b11 tempest-ProjectReaderTests-294031119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-611c92c0-34d2-4b0f-b128-a03b964f4b11 tempest-ProjectReaderTests-294031119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-611c92c0-34d2-4b0f-b128-a03b964f4b11 tempest-ProjectReaderTests-294031119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:05 devstack sudo[106416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:32:05 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:06 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-16c4e490-e875-4e2b-9847-e2435908c379 tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22" returned: 0 in 0.594s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-16c4e490-e875-4e2b-9847-e2435908c379 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:06 devstack sudo[106423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22
Sep 16 16:32:06 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:06 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-611c92c0-34d2-4b0f-b128-a03b964f4b11 tempest-ProjectReaderTests-294031119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.459s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-611c92c0-34d2-4b0f-b128-a03b964f4b11 tempest-ProjectReaderTests-294031119 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:32:06 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-611c92c0-34d2-4b0f-b128-a03b964f4b11 tempest-ProjectReaderTests-294031119 None] Deleted volume successfully.
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Flow 'volume_create_manager' (f38b170f-7ef9-49f4-a074-efe3f787da38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6341790e-ada2-46b0-8e44-3e141611fa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6341790e-ada2-46b0-8e44-3e141611fa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79bd2460-db35-4f3c-88e5-cd77bb109b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1c57ac52dd040e9b25de256e52c78fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:06Z,use_quota=True,user_id='3d7ddcdd830f4293bae5234b2771ed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4b662b5-ee0f-4885-8de6-f87a9c0ac944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4b662b5-ee0f-4885-8de6-f87a9c0ac944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf07cab1-a9e1-4cba-a489-f5e2c92a5130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf07cab1-a9e1-4cba-a489-f5e2c92a5130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79bd2460-db35-4f3c-88e5-cd77bb109b25', 'volume_name': 'volume-79bd2460-db35-4f3c-88e5-cd77bb109b25', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb05d76-d43f-4c6a-b5cd-0e16dafed989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb05d76-d43f-4c6a-b5cd-0e16dafed989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aba2356-f2fb-49fe-9a09-2605c5788845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:06 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Volume 79bd2460-db35-4f3c-88e5-cd77bb109b25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79bd2460-db35-4f3c-88e5-cd77bb109b25', 'volume_size': 1}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79bd2460-db35-4f3c-88e5-cd77bb109b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1c57ac52dd040e9b25de256e52c78fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:06Z,use_quota=True,user_id='3d7ddcdd830f4293bae5234b2771ed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Creating volume 79bd2460-db35-4f3c-88e5-cd77bb109b25 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:32:06 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-79bd2460-db35-4f3c-88e5-cd77bb109b25 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-611c92c0-34d2-4b0f-b128-a03b964f4b11 tempest-ProjectReaderTests-294031119 None] Lock "cinder-4a24bbce-8dba-4b86-96be-e79cc7aaa012-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:06 devstack sudo[106425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-79bd2460-db35-4f3c-88e5-cd77bb109b25 1073741824
Sep 16 16:32:06 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Flow 'volume_create_manager' (642f3076-9fae-4c2e-aa07-8e77f5b905bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008daab3-7854-4282-a58b-b3ab2d2e319a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:06 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-16c4e490-e875-4e2b-9847-e2435908c379 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0cd012fc-ced6-4caa-851d-3d09d001ac22" returned: 0 in 0.633s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008daab3-7854-4282-a58b-b3ab2d2e319a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1498302550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc81eb6d-93be-434a-9d77-42573c60d41e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2081234a0841ebb70dd376a2636466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:07Z,use_quota=True,user_id='6dd42f1fbabe4a4bbc5462522d3bcf8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb0252b-3cd1-469a-a1c9-62d89e09ac3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb0252b-3cd1-469a-a1c9-62d89e09ac3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad023128-0e39-47be-b141-88c8f5f9359d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad023128-0e39-47be-b141-88c8f5f9359d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc81eb6d-93be-434a-9d77-42573c60d41e', 'volume_name': 'volume-bc81eb6d-93be-434a-9d77-42573c60d41e', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a594933-bd64-476c-b842-70eb011d901d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a594933-bd64-476c-b842-70eb011d901d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865f1e5b-c76a-4194-a56f-4d2a01d89167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:06 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Volume bc81eb6d-93be-434a-9d77-42573c60d41e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc81eb6d-93be-434a-9d77-42573c60d41e', 'volume_size': 1}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-16c4e490-e875-4e2b-9847-e2435908c379 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-0cd012fc-ced6-4caa-851d-3d09d001ac22" released by "delete_volume" :: held 1.391s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-16c4e490-e875-4e2b-9847-e2435908c379 tempest-ProjectMemberTests-864664885 None] Created reservations ['9be5a09b-fdc2-4bf1-9d7c-ea15279a90f4', 'e66cbcb4-bff4-4e24-bc87-94ccbfd680d3', '03e68249-47af-4353-82f5-4d0bd1e0fd42', 'db95c427-a1a8-4bdf-bdb3-fc182dc8de21'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-16c4e490-e875-4e2b-9847-e2435908c379 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-16c4e490-e875-4e2b-9847-e2435908c379 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-16c4e490-e875-4e2b-9847-e2435908c379 tempest-ProjectMemberTests-864664885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-16c4e490-e875-4e2b-9847-e2435908c379 tempest-ProjectMemberTests-864664885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-16c4e490-e875-4e2b-9847-e2435908c379 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-16c4e490-e875-4e2b-9847-e2435908c379 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:07 devstack sudo[106465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:32:07 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:07 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-79bd2460-db35-4f3c-88e5-cd77bb109b25 1073741824" returned: 0 in 0.691s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-79bd2460-db35-4f3c-88e5-cd77bb109b25 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:07 devstack sudo[106469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:32:07 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:07 devstack sudo[106471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-79bd2460-db35-4f3c-88e5-cd77bb109b25
Sep 16 16:32:07 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:07 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-16c4e490-e875-4e2b-9847-e2435908c379 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.325s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-16c4e490-e875-4e2b-9847-e2435908c379 tempest-ProjectMemberTests-864664885 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:32:07 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-16c4e490-e875-4e2b-9847-e2435908c379 tempest-ProjectMemberTests-864664885 None] Deleted volume successfully.
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-16c4e490-e875-4e2b-9847-e2435908c379 tempest-ProjectMemberTests-864664885 None] Lock "cinder-0cd012fc-ced6-4caa-851d-3d09d001ac22-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:07 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.328s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 29 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>, <Thread(tpool_thread_0, started daemon 135438770624192)>, <Thread(tpool_thread_1, started daemon 135438762231488)>, <Thread(tpool_thread_2, started daemon 135438753838784)>, <Thread(tpool_thread_3, started daemon 135438745446080)>, <Thread(tpool_thread_4, started daemon 135438737053376)>, <Thread(tpool_thread_5, started daemon 135438728660672)>, <Thread(tpool_thread_6, started daemon 135438720267968)>, <Thread(tpool_thread_7, started daemon 135438711875264)>, <Thread(tpool_thread_8, started daemon 135438703466176)>, <Thread(tpool_thread_9, started daemon 135438695057088)>, <Thread(tpool_thread_10, started daemon 135438686648000)>, <Thread(tpool_thread_11, started daemon 135438678238912)>, <Thread(tpool_thread_12, started daemon 135438669829824)>, <Thread(tpool_thread_13, started daemon 135438661420736)>, <Thread(tpool_thread_14, started daemon 135438653011648)>, <Thread(tpool_thread_15, started daemon 135438644602560)>, <Thread(tpool_thread_16, started daemon 135438636193472)>, <Thread(tpool_thread_17, started daemon 135438627784384)>, <Thread(tpool_thread_18, started daemon 135438619375296)>, <Thread(tpool_thread_19, started daemon 135438610966208)>, <Thread(Rabbit-heartbeat, started daemon 135438772197760)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:32:07 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-79bd2460-db35-4f3c-88e5-cd77bb109b25" returned: 0 in 0.363s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.755s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1498302550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc81eb6d-93be-434a-9d77-42573c60d41e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2081234a0841ebb70dd376a2636466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:07Z,use_quota=True,user_id='6dd42f1fbabe4a4bbc5462522d3bcf8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Creating volume bc81eb6d-93be-434a-9d77-42573c60d41e {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:32:07 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc81eb6d-93be-434a-9d77-42573c60d41e 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aba2356-f2fb-49fe-9a09-2605c5788845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79bd2460-db35-4f3c-88e5-cd77bb109b25', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:07 devstack sudo[106476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc81eb6d-93be-434a-9d77-42573c60d41e 1073741824
Sep 16 16:32:07 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f977b766-8761-4a00-b1c7-7e549136fbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:07 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Volume volume-79bd2460-db35-4f3c-88e5-cd77bb109b25 (79bd2460-db35-4f3c-88e5-cd77bb109b25): created successfully
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f977b766-8761-4a00-b1c7-7e549136fbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Flow 'volume_create_manager' (f38b170f-7ef9-49f4-a074-efe3f787da38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:07 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-14bf073e-71e6-4112-a450-c76619854a95 tempest-CinderUnicodeTest-110830540 None] Created volume successfully.
Sep 16 16:32:08 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc81eb6d-93be-434a-9d77-42573c60d41e 1073741824" returned: 0 in 0.630s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc81eb6d-93be-434a-9d77-42573c60d41e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:32:08 devstack sudo[106482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc81eb6d-93be-434a-9d77-42573c60d41e
Sep 16 16:32:08 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Flow 'volume_create_manager' (dba1d2b5-b2c2-467e-88c4-5cf886c3e48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f560a4-acfd-4934-922c-02a47486a0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f560a4-acfd-4934-922c-02a47486a0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-306105482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4be84013f847d4a2f15dde740a2536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:08Z,use_quota=True,user_id='ae825737116546298fd942e8502abe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02f7556-5828-4f61-90da-605cffa68f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02f7556-5828-4f61-90da-605cffa68f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b35ad3e5-742c-4e1f-9627-95a68f48e4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b35ad3e5-742c-4e1f-9627-95a68f48e4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0', 'volume_name': 'volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c6c731-dcba-4cbc-96bb-8f1d14dbd05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c6c731-dcba-4cbc-96bb-8f1d14dbd05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dea6c8b-a21a-4b14-b9cb-3d00e5843f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:08 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Volume 47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0', 'volume_size': 1}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:08 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc81eb6d-93be-434a-9d77-42573c60d41e" returned: 0 in 0.288s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.197s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-306105482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4be84013f847d4a2f15dde740a2536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:08Z,use_quota=True,user_id='ae825737116546298fd942e8502abe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Creating volume 47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:32:08 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865f1e5b-c76a-4194-a56f-4d2a01d89167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc81eb6d-93be-434a-9d77-42573c60d41e', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:08 devstack sudo[106485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0 1073741824
Sep 16 16:32:08 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f91ec3-ee3b-4776-b32e-09e1af2ba1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:08 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Volume volume-bc81eb6d-93be-434a-9d77-42573c60d41e (bc81eb6d-93be-434a-9d77-42573c60d41e): created successfully
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f91ec3-ee3b-4776-b32e-09e1af2ba1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Flow 'volume_create_manager' (642f3076-9fae-4c2e-aa07-8e77f5b905bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:08 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-8a55278b-cd2f-424c-84b1-379199902dce tempest-ProjectReaderTests-294031119 None] Created volume successfully.
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Flow 'volume_create_manager' (654c29ff-2f31-4b37-8292-9282b631c845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d5228d-1871-49f7-9a7d-6df705ad908b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d5228d-1871-49f7-9a7d-6df705ad908b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-312385473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4611ad9-a01f-4d41-b068-bd16739651ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1c57ac52dd040e9b25de256e52c78fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:09Z,use_quota=True,user_id='3d7ddcdd830f4293bae5234b2771ed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe9272c-84d1-4c79-8b42-a1784364a41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe9272c-84d1-4c79-8b42-a1784364a41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7df8e41-f8a3-4d82-9b5c-9a42e25551b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7df8e41-f8a3-4d82-9b5c-9a42e25551b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4611ad9-a01f-4d41-b068-bd16739651ea', 'volume_name': 'volume-f4611ad9-a01f-4d41-b068-bd16739651ea', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f3d4d78-2bda-4ad9-9356-0a6e9a3e2616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f3d4d78-2bda-4ad9-9356-0a6e9a3e2616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb5726d-1645-4a0a-b784-cd0c7855acb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:09 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Volume f4611ad9-a01f-4d41-b068-bd16739651ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4611ad9-a01f-4d41-b068-bd16739651ea', 'volume_size': 1}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:09 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0 1073741824" returned: 0 in 0.751s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:09 devstack sudo[106491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0
Sep 16 16:32:09 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:09 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0" returned: 0 in 0.258s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.483s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-312385473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4611ad9-a01f-4d41-b068-bd16739651ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1c57ac52dd040e9b25de256e52c78fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:09Z,use_quota=True,user_id='3d7ddcdd830f4293bae5234b2771ed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Creating volume f4611ad9-a01f-4d41-b068-bd16739651ea {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:32:09 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dea6c8b-a21a-4b14-b9cb-3d00e5843f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:09 devstack sudo[106494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea 1073741824
Sep 16 16:32:09 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e10196ce-7e59-49c0-94fb-6cd39230e8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:09 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Volume volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0 (47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0): created successfully
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e10196ce-7e59-49c0-94fb-6cd39230e8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Flow 'volume_create_manager' (dba1d2b5-b2c2-467e-88c4-5cf886c3e48d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:09 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-0000e5fe-8145-4f9b-87bf-aa3dae79251a tempest-ProjectMemberTests-864664885 None] Created volume successfully.
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bd5587e7-eab3-48a0-a992-15b0ae481124 tempest-ProjectReaderTests-294031119 None] Acquiring lock "cinder-bc81eb6d-93be-434a-9d77-42573c60d41e-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bd5587e7-eab3-48a0-a992-15b0ae481124 tempest-ProjectReaderTests-294031119 None] Lock "cinder-bc81eb6d-93be-434a-9d77-42573c60d41e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:10 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bd5587e7-eab3-48a0-a992-15b0ae481124 tempest-ProjectReaderTests-294031119 None] Acquiring lock "cinder-quobyte-bc81eb6d-93be-434a-9d77-42573c60d41e" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:10 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bd5587e7-eab3-48a0-a992-15b0ae481124 tempest-ProjectReaderTests-294031119 None] Lock "cinder-quobyte-bc81eb6d-93be-434a-9d77-42573c60d41e" acquired by "delete_volume" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:10 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d5efc7-9dea-4deb-bc78-d5f2150807b0]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bd5587e7-eab3-48a0-a992-15b0ae481124 tempest-ProjectReaderTests-294031119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc81eb6d-93be-434a-9d77-42573c60d41e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:10 devstack sudo[106499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc81eb6d-93be-434a-9d77-42573c60d41e
Sep 16 16:32:10 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:10 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea 1073741824" returned: 0 in 0.686s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:10 devstack sudo[106502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea
Sep 16 16:32:10 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:10 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bd5587e7-eab3-48a0-a992-15b0ae481124 tempest-ProjectReaderTests-294031119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc81eb6d-93be-434a-9d77-42573c60d41e" returned: 0 in 0.552s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bd5587e7-eab3-48a0-a992-15b0ae481124 tempest-ProjectReaderTests-294031119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc81eb6d-93be-434a-9d77-42573c60d41e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:10 devstack sudo[106508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc81eb6d-93be-434a-9d77-42573c60d41e
Sep 16 16:32:10 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-29e893f5-91cd-41b8-ba3e-ca533d8613e6 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:10 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea" returned: 0 in 0.353s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:32:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-29e893f5-91cd-41b8-ba3e-ca533d8613e6 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.100s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:10 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-29e893f5-91cd-41b8-ba3e-ca533d8613e6 tempest-ProjectMemberTests-864664885 None] Creating offline snapshot 7879728c-3817-460e-a632-b66af9c897a8 of volume 47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:32:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb5726d-1645-4a0a-b784-cd0c7855acb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4611ad9-a01f-4d41-b068-bd16739651ea', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3eb7320-a8f7-483a-afd9-33694fe95b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:10 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7128e6b2-ee55-4d7e-96f9-cb22bb3a254c]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29e893f5-91cd-41b8-ba3e-ca533d8613e6 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:10 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Volume volume-f4611ad9-a01f-4d41-b068-bd16739651ea (f4611ad9-a01f-4d41-b068-bd16739651ea): created successfully
Sep 16 16:32:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3eb7320-a8f7-483a-afd9-33694fe95b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Flow 'volume_create_manager' (654c29ff-2f31-4b37-8292-9282b631c845) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:10 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-ba130098-fb12-460e-a049-0b1a97d97e3f tempest-CinderUnicodeTest-110830540 None] Created volume successfully.
Sep 16 16:32:11 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bd5587e7-eab3-48a0-a992-15b0ae481124 tempest-ProjectReaderTests-294031119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-bc81eb6d-93be-434a-9d77-42573c60d41e" returned: 0 in 0.355s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:11 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bd5587e7-eab3-48a0-a992-15b0ae481124 tempest-ProjectReaderTests-294031119 None] Lock "cinder-quobyte-bc81eb6d-93be-434a-9d77-42573c60d41e" released by "delete_volume" :: held 0.972s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:11 devstack sudo[106511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0
Sep 16 16:32:11 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:11 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-bd5587e7-eab3-48a0-a992-15b0ae481124 tempest-ProjectReaderTests-294031119 None] Created reservations ['6c6b03c7-5f71-4025-bded-088b171753f4', 'd5fad098-6c33-44eb-afb1-caf57d8dc9c7', '20ec0135-9764-46d1-bc25-da788dd229e5', '27ec916e-b571-4e99-b10a-36fefa8ac88c'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bd5587e7-eab3-48a0-a992-15b0ae481124 tempest-ProjectReaderTests-294031119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bd5587e7-eab3-48a0-a992-15b0ae481124 tempest-ProjectReaderTests-294031119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-bd5587e7-eab3-48a0-a992-15b0ae481124 tempest-ProjectReaderTests-294031119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-bd5587e7-eab3-48a0-a992-15b0ae481124 tempest-ProjectReaderTests-294031119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bd5587e7-eab3-48a0-a992-15b0ae481124 tempest-ProjectReaderTests-294031119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bd5587e7-eab3-48a0-a992-15b0ae481124 tempest-ProjectReaderTests-294031119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:11 devstack sudo[106515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:32:11 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:11 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29e893f5-91cd-41b8-ba3e-ca533d8613e6 tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0" returned: 0 in 0.580s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29e893f5-91cd-41b8-ba3e-ca533d8613e6 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.7879728c-3817-460e-a632-b66af9c897a8 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:11 devstack sudo[106520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.7879728c-3817-460e-a632-b66af9c897a8 1G
Sep 16 16:32:11 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:11 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-14c9d589-b717-47b6-8387-de82c74edb64 tempest-CinderUnicodeTest-110830540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bd5587e7-eab3-48a0-a992-15b0ae481124 tempest-ProjectReaderTests-294031119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.348s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:11 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-bd5587e7-eab3-48a0-a992-15b0ae481124 tempest-ProjectReaderTests-294031119 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:32:11 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-bd5587e7-eab3-48a0-a992-15b0ae481124 tempest-ProjectReaderTests-294031119 None] Deleted volume successfully.
Sep 16 16:32:11 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bd5587e7-eab3-48a0-a992-15b0ae481124 tempest-ProjectReaderTests-294031119 None] Lock "cinder-bc81eb6d-93be-434a-9d77-42573c60d41e-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:12 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29e893f5-91cd-41b8-ba3e-ca533d8613e6 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.7879728c-3817-460e-a632-b66af9c897a8 1G" returned: 0 in 0.582s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29e893f5-91cd-41b8-ba3e-ca533d8613e6 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.7879728c-3817-460e-a632-b66af9c897a8 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:12 devstack sudo[106526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.7879728c-3817-460e-a632-b66af9c897a8
Sep 16 16:32:12 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:12 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29e893f5-91cd-41b8-ba3e-ca533d8613e6 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.7879728c-3817-460e-a632-b66af9c897a8" returned: 0 in 0.355s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:12 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-29e893f5-91cd-41b8-ba3e-ca533d8613e6 tempest-ProjectMemberTests-864664885 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.7879728c-3817-460e-a632-b66af9c897a8 is being set with open permissions: ugo+rw
Sep 16 16:32:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29e893f5-91cd-41b8-ba3e-ca533d8613e6 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.7879728c-3817-460e-a632-b66af9c897a8 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:12 devstack sudo[106531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.7879728c-3817-460e-a632-b66af9c897a8
Sep 16 16:32:12 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:12 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29e893f5-91cd-41b8-ba3e-ca533d8613e6 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.7879728c-3817-460e-a632-b66af9c897a8" returned: 0 in 0.343s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29e893f5-91cd-41b8-ba3e-ca533d8613e6 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:12 devstack sudo[106534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.info
Sep 16 16:32:12 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:12 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:32:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Flow 'volume_create_manager' (acfe5163-89f3-4a08-8a09-e1311cc894aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cec029c-86a1-4fb8-a200-0d8cb6c3d65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cec029c-86a1-4fb8-a200-0d8cb6c3d65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-947757397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3876d08b-af86-4e1c-adce-77b16d75357e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2081234a0841ebb70dd376a2636466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:13Z,use_quota=True,user_id='6dd42f1fbabe4a4bbc5462522d3bcf8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cabfdf70-4e6f-48e2-9383-bdfcdaf1c1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cabfdf70-4e6f-48e2-9383-bdfcdaf1c1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db292895-7dd4-4abd-b4c1-a68b5519598c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db292895-7dd4-4abd-b4c1-a68b5519598c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3876d08b-af86-4e1c-adce-77b16d75357e', 'volume_name': 'volume-3876d08b-af86-4e1c-adce-77b16d75357e', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0588d64-4141-4dc1-bba7-0a3099e15514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0588d64-4141-4dc1-bba7-0a3099e15514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d8b0a57-ebbe-4e9f-bec6-7e6d828d110b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:12 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Volume 3876d08b-af86-4e1c-adce-77b16d75357e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3876d08b-af86-4e1c-adce-77b16d75357e', 'volume_size': 1}
Sep 16 16:32:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:13 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29e893f5-91cd-41b8-ba3e-ca533d8613e6 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.info" returned: 0 in 0.318s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:13 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-29e893f5-91cd-41b8-ba3e-ca533d8613e6 tempest-ProjectMemberTests-864664885 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.info is being set with open permissions: ugo+rw
Sep 16 16:32:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29e893f5-91cd-41b8-ba3e-ca533d8613e6 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:13 devstack sudo[106537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.info
Sep 16 16:32:13 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:13 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-29e893f5-91cd-41b8-ba3e-ca533d8613e6 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.info" returned: 0 in 0.254s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-29e893f5-91cd-41b8-ba3e-ca533d8613e6 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.550s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-14c9d589-b717-47b6-8387-de82c74edb64 tempest-CinderUnicodeTest-110830540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.798s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-14c9d589-b717-47b6-8387-de82c74edb64 tempest-CinderUnicodeTest-110830540 None] Creating offline snapshot c8456259-2ec2-48e3-9576-c3ce2395d437 of volume f4611ad9-a01f-4d41-b068-bd16739651ea {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:32:13 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-29e893f5-91cd-41b8-ba3e-ca533d8613e6 tempest-ProjectMemberTests-864664885 None] Create snapshot completed successfully
Sep 16 16:32:13 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e615c82-7b61-4cd1-be76-e4ef238fccfe]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-14c9d589-b717-47b6-8387-de82c74edb64 tempest-CinderUnicodeTest-110830540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:13 devstack sudo[106546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea
Sep 16 16:32:13 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-aa46aa6f-0adc-48c4-807c-c6311114a04b tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-7879728c-3817-460e-a632-b66af9c897a8-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:13 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-14c9d589-b717-47b6-8387-de82c74edb64 tempest-CinderUnicodeTest-110830540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea" returned: 0 in 0.440s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-14c9d589-b717-47b6-8387-de82c74edb64 tempest-CinderUnicodeTest-110830540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.c8456259-2ec2-48e3-9576-c3ce2395d437 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-aa46aa6f-0adc-48c4-807c-c6311114a04b tempest-ProjectMemberTests-864664885 None] Lock "cinder-7879728c-3817-460e-a632-b66af9c897a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-aa46aa6f-0adc-48c4-807c-c6311114a04b tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-aa46aa6f-0adc-48c4-807c-c6311114a04b tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-aa46aa6f-0adc-48c4-807c-c6311114a04b tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-7879728c-3817-460e-a632-b66af9c897a8" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:13 devstack sudo[106551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.c8456259-2ec2-48e3-9576-c3ce2395d437 1G
Sep 16 16:32:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-aa46aa6f-0adc-48c4-807c-c6311114a04b tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-7879728c-3817-460e-a632-b66af9c897a8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:13 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-aa46aa6f-0adc-48c4-807c-c6311114a04b tempest-ProjectMemberTests-864664885 None] Deleting offline snapshot 7879728c-3817-460e-a632-b66af9c897a8 of volume 47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:32:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-aa46aa6f-0adc-48c4-807c-c6311114a04b tempest-ProjectMemberTests-864664885 None] snapshot_file for this snap is: volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.7879728c-3817-460e-a632-b66af9c897a8 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:32:13 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[101313ef-62ce-4a9e-a662-2247324a1a4a]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-aa46aa6f-0adc-48c4-807c-c6311114a04b tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.7879728c-3817-460e-a632-b66af9c897a8 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:14 devstack sudo[106553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.7879728c-3817-460e-a632-b66af9c897a8
Sep 16 16:32:14 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:14 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-14c9d589-b717-47b6-8387-de82c74edb64 tempest-CinderUnicodeTest-110830540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.c8456259-2ec2-48e3-9576-c3ce2395d437 1G" returned: 0 in 0.563s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-14c9d589-b717-47b6-8387-de82c74edb64 tempest-CinderUnicodeTest-110830540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4611ad9-a01f-4d41-b068-bd16739651ea -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.c8456259-2ec2-48e3-9576-c3ce2395d437 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:14 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-aa46aa6f-0adc-48c4-807c-c6311114a04b tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.7879728c-3817-460e-a632-b66af9c897a8" returned: 0 in 0.474s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:14 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-aa46aa6f-0adc-48c4-807c-c6311114a04b tempest-ProjectMemberTests-864664885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:32:14 devstack sudo[106561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4611ad9-a01f-4d41-b068-bd16739651ea -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.c8456259-2ec2-48e3-9576-c3ce2395d437
Sep 16 16:32:14 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:14 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6eb9ae9-f6a6-4b6f-adcc-c6f98c2b1c23]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-aa46aa6f-0adc-48c4-807c-c6311114a04b tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:14 devstack sudo[106563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0
Sep 16 16:32:14 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:14 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-14c9d589-b717-47b6-8387-de82c74edb64 tempest-CinderUnicodeTest-110830540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4611ad9-a01f-4d41-b068-bd16739651ea -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.c8456259-2ec2-48e3-9576-c3ce2395d437" returned: 0 in 0.340s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:14 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-14c9d589-b717-47b6-8387-de82c74edb64 tempest-CinderUnicodeTest-110830540 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.c8456259-2ec2-48e3-9576-c3ce2395d437 is being set with open permissions: ugo+rw
Sep 16 16:32:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-14c9d589-b717-47b6-8387-de82c74edb64 tempest-CinderUnicodeTest-110830540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.c8456259-2ec2-48e3-9576-c3ce2395d437 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:14 devstack sudo[106569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.c8456259-2ec2-48e3-9576-c3ce2395d437
Sep 16 16:32:14 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:14 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-aa46aa6f-0adc-48c4-807c-c6311114a04b tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0" returned: 0 in 0.475s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-aa46aa6f-0adc-48c4-807c-c6311114a04b tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.7879728c-3817-460e-a632-b66af9c897a8 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:15 devstack sudo[106574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.7879728c-3817-460e-a632-b66af9c897a8
Sep 16 16:32:15 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:15 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-14c9d589-b717-47b6-8387-de82c74edb64 tempest-CinderUnicodeTest-110830540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.c8456259-2ec2-48e3-9576-c3ce2395d437" returned: 0 in 0.298s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-14c9d589-b717-47b6-8387-de82c74edb64 tempest-CinderUnicodeTest-110830540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:15 devstack sudo[106577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.info
Sep 16 16:32:15 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:15 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-aa46aa6f-0adc-48c4-807c-c6311114a04b tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.7879728c-3817-460e-a632-b66af9c897a8" returned: 0 in 0.435s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-aa46aa6f-0adc-48c4-807c-c6311114a04b tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.7879728c-3817-460e-a632-b66af9c897a8 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:15 devstack sudo[106583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.7879728c-3817-460e-a632-b66af9c897a8
Sep 16 16:32:15 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:15 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-14c9d589-b717-47b6-8387-de82c74edb64 tempest-CinderUnicodeTest-110830540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.info" returned: 0 in 0.320s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:15 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-14c9d589-b717-47b6-8387-de82c74edb64 tempest-CinderUnicodeTest-110830540 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.info is being set with open permissions: ugo+rw
Sep 16 16:32:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-14c9d589-b717-47b6-8387-de82c74edb64 tempest-CinderUnicodeTest-110830540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:15 devstack sudo[106587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.info
Sep 16 16:32:15 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:15 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-aa46aa6f-0adc-48c4-807c-c6311114a04b tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0.7879728c-3817-460e-a632-b66af9c897a8" returned: 0 in 0.297s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:15 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-14c9d589-b717-47b6-8387-de82c74edb64 tempest-CinderUnicodeTest-110830540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.info" returned: 0 in 0.298s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-14c9d589-b717-47b6-8387-de82c74edb64 tempest-CinderUnicodeTest-110830540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.409s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-aa46aa6f-0adc-48c4-807c-c6311114a04b tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-7879728c-3817-460e-a632-b66af9c897a8" released by "_delete_snapshot" :: held 1.856s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.827s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-947757397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3876d08b-af86-4e1c-adce-77b16d75357e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2081234a0841ebb70dd376a2636466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:13Z,use_quota=True,user_id='6dd42f1fbabe4a4bbc5462522d3bcf8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:32:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Creating volume 3876d08b-af86-4e1c-adce-77b16d75357e {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:32:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:15 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:32:15 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:32:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3876d08b-af86-4e1c-adce-77b16d75357e 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-aa46aa6f-0adc-48c4-807c-c6311114a04b tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0" released by "delete_snapshot" :: held 1.923s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:15 devstack sudo[106591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3876d08b-af86-4e1c-adce-77b16d75357e 1073741824
Sep 16 16:32:15 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:15 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-14c9d589-b717-47b6-8387-de82c74edb64 tempest-CinderUnicodeTest-110830540 None] Create snapshot completed successfully
Sep 16 16:32:15 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-aa46aa6f-0adc-48c4-807c-c6311114a04b tempest-ProjectMemberTests-864664885 None] Created reservations ['82a8f3bb-4236-4ba4-ba6a-20cff6bec8bb', '23fbdf68-b7ba-4d51-8cb6-a97026b754b1', '2dfb927c-f06f-4674-80d5-85bdaaf3c0bb', '45757681-509f-471d-8399-3083a3eff6bc'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:16 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-aa46aa6f-0adc-48c4-807c-c6311114a04b tempest-ProjectMemberTests-864664885 None] Delete snapshot completed successfully.
Sep 16 16:32:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-aa46aa6f-0adc-48c4-807c-c6311114a04b tempest-ProjectMemberTests-864664885 None] Lock "cinder-7879728c-3817-460e-a632-b66af9c897a8-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:16 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3876d08b-af86-4e1c-adce-77b16d75357e 1073741824" returned: 0 in 0.723s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3876d08b-af86-4e1c-adce-77b16d75357e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:16 devstack sudo[106597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3876d08b-af86-4e1c-adce-77b16d75357e
Sep 16 16:32:16 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6ff7489e-e1f2-4a86-a484-4ffb8eafc76c tempest-CinderUnicodeTest-110830540 None] Acquiring lock "cinder-c8456259-2ec2-48e3-9576-c3ce2395d437-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:16 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3876d08b-af86-4e1c-adce-77b16d75357e" returned: 0 in 0.306s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:32:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6ff7489e-e1f2-4a86-a484-4ffb8eafc76c tempest-CinderUnicodeTest-110830540 None] Lock "cinder-c8456259-2ec2-48e3-9576-c3ce2395d437-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6ff7489e-e1f2-4a86-a484-4ffb8eafc76c tempest-CinderUnicodeTest-110830540 None] Acquiring lock "cinder-quobyte-f4611ad9-a01f-4d41-b068-bd16739651ea" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d8b0a57-ebbe-4e9f-bec6-7e6d828d110b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3876d08b-af86-4e1c-adce-77b16d75357e', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc5926b-db3e-43fd-885e-79c6c5dd85cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6ff7489e-e1f2-4a86-a484-4ffb8eafc76c tempest-CinderUnicodeTest-110830540 None] Lock "cinder-quobyte-f4611ad9-a01f-4d41-b068-bd16739651ea" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6ff7489e-e1f2-4a86-a484-4ffb8eafc76c tempest-CinderUnicodeTest-110830540 None] Acquiring lock "cinder-quobyte-c8456259-2ec2-48e3-9576-c3ce2395d437" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:16 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Volume volume-3876d08b-af86-4e1c-adce-77b16d75357e (3876d08b-af86-4e1c-adce-77b16d75357e): created successfully
Sep 16 16:32:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc5926b-db3e-43fd-885e-79c6c5dd85cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:16 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Flow 'volume_create_manager' (acfe5163-89f3-4a08-8a09-e1311cc894aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6ff7489e-e1f2-4a86-a484-4ffb8eafc76c tempest-CinderUnicodeTest-110830540 None] Lock "cinder-quobyte-c8456259-2ec2-48e3-9576-c3ce2395d437" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-6ff7489e-e1f2-4a86-a484-4ffb8eafc76c tempest-CinderUnicodeTest-110830540 None] Deleting offline snapshot c8456259-2ec2-48e3-9576-c3ce2395d437 of volume f4611ad9-a01f-4d41-b068-bd16739651ea {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-6ff7489e-e1f2-4a86-a484-4ffb8eafc76c tempest-CinderUnicodeTest-110830540 None] snapshot_file for this snap is: volume-f4611ad9-a01f-4d41-b068-bd16739651ea.c8456259-2ec2-48e3-9576-c3ce2395d437 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:32:17 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-87eaf199-7808-4d4e-a4ff-d152e5327289 tempest-ProjectReaderTests-294031119 None] Created volume successfully.
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3eb091-6164-471e-9438-bd740268f8fa]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6ff7489e-e1f2-4a86-a484-4ffb8eafc76c tempest-CinderUnicodeTest-110830540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.c8456259-2ec2-48e3-9576-c3ce2395d437 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0b896c92-368f-46b0-ba8f-c41cf9ed9395 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:17 devstack sudo[106600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.c8456259-2ec2-48e3-9576-c3ce2395d437
Sep 16 16:32:17 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0b896c92-368f-46b0-ba8f-c41cf9ed9395 tempest-ProjectMemberTests-864664885 None] Lock "cinder-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2212ec8c-dc14-4272-9f84-83d04e8cebff tempest-ProjectReaderTests-294031119 None] Acquiring lock "cinder-3876d08b-af86-4e1c-adce-77b16d75357e-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0b896c92-368f-46b0-ba8f-c41cf9ed9395 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2212ec8c-dc14-4272-9f84-83d04e8cebff tempest-ProjectReaderTests-294031119 None] Lock "cinder-3876d08b-af86-4e1c-adce-77b16d75357e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0b896c92-368f-46b0-ba8f-c41cf9ed9395 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0" acquired by "delete_volume" :: waited 0.027s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f06f190-1591-42b2-95b8-3a8560db1b12]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0b896c92-368f-46b0-ba8f-c41cf9ed9395 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2212ec8c-dc14-4272-9f84-83d04e8cebff tempest-ProjectReaderTests-294031119 None] Acquiring lock "cinder-quobyte-3876d08b-af86-4e1c-adce-77b16d75357e" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2212ec8c-dc14-4272-9f84-83d04e8cebff tempest-ProjectReaderTests-294031119 None] Lock "cinder-quobyte-3876d08b-af86-4e1c-adce-77b16d75357e" acquired by "delete_volume" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21da182-1f8c-4368-b771-e78edad2e8f0]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2212ec8c-dc14-4272-9f84-83d04e8cebff tempest-ProjectReaderTests-294031119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3876d08b-af86-4e1c-adce-77b16d75357e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:17 devstack sudo[106602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0
Sep 16 16:32:17 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:17 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6ff7489e-e1f2-4a86-a484-4ffb8eafc76c tempest-CinderUnicodeTest-110830540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.c8456259-2ec2-48e3-9576-c3ce2395d437" returned: 0 in 0.535s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-6ff7489e-e1f2-4a86-a484-4ffb8eafc76c tempest-CinderUnicodeTest-110830540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4611ad9-a01f-4d41-b068-bd16739651ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:32:17 devstack sudo[106603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3876d08b-af86-4e1c-adce-77b16d75357e
Sep 16 16:32:17 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c6fec1-20dd-4a2d-83d3-bfaac756d228]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6ff7489e-e1f2-4a86-a484-4ffb8eafc76c tempest-CinderUnicodeTest-110830540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:17 devstack sudo[106610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea
Sep 16 16:32:17 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:17 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0b896c92-368f-46b0-ba8f-c41cf9ed9395 tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0" returned: 0 in 0.496s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0b896c92-368f-46b0-ba8f-c41cf9ed9395 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:17 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2212ec8c-dc14-4272-9f84-83d04e8cebff tempest-ProjectReaderTests-294031119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3876d08b-af86-4e1c-adce-77b16d75357e" returned: 0 in 0.468s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2212ec8c-dc14-4272-9f84-83d04e8cebff tempest-ProjectReaderTests-294031119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3876d08b-af86-4e1c-adce-77b16d75357e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:17 devstack sudo[106618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0
Sep 16 16:32:17 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:17 devstack sudo[106620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3876d08b-af86-4e1c-adce-77b16d75357e
Sep 16 16:32:17 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:18 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6ff7489e-e1f2-4a86-a484-4ffb8eafc76c tempest-CinderUnicodeTest-110830540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea" returned: 0 in 0.527s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6ff7489e-e1f2-4a86-a484-4ffb8eafc76c tempest-CinderUnicodeTest-110830540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.c8456259-2ec2-48e3-9576-c3ce2395d437 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:18 devstack sudo[106625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.c8456259-2ec2-48e3-9576-c3ce2395d437
Sep 16 16:32:18 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:18 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0b896c92-368f-46b0-ba8f-c41cf9ed9395 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0" returned: 0 in 0.368s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:18 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2212ec8c-dc14-4272-9f84-83d04e8cebff tempest-ProjectReaderTests-294031119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3876d08b-af86-4e1c-adce-77b16d75357e" returned: 0 in 0.350s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0b896c92-368f-46b0-ba8f-c41cf9ed9395 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0" released by "delete_volume" :: held 0.971s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2212ec8c-dc14-4272-9f84-83d04e8cebff tempest-ProjectReaderTests-294031119 None] Lock "cinder-quobyte-3876d08b-af86-4e1c-adce-77b16d75357e" released by "delete_volume" :: held 0.893s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-2212ec8c-dc14-4272-9f84-83d04e8cebff tempest-ProjectReaderTests-294031119 None] Created reservations ['6d69d5f2-3334-4d39-8cd8-b8b4b7b55388', '77895e2d-5cdb-463c-9a1a-f73918190b90', 'e180bdc2-ba11-495b-84dc-c5dcd07895a2', 'b256dfa1-9437-4cef-9188-1ade5bb7085a'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-0b896c92-368f-46b0-ba8f-c41cf9ed9395 tempest-ProjectMemberTests-864664885 None] Created reservations ['c845fbcd-d0a0-4ffe-bf9b-52e75dfcbcc5', 'd30b58f0-f387-4fd4-86b1-1d2fb8ce64b3', '6eae1a35-277b-43d6-aa00-1d4adaf3c7d4', 'e012c289-e138-44d9-bcad-42f2bb52de1f'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2212ec8c-dc14-4272-9f84-83d04e8cebff tempest-ProjectReaderTests-294031119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2212ec8c-dc14-4272-9f84-83d04e8cebff tempest-ProjectReaderTests-294031119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2212ec8c-dc14-4272-9f84-83d04e8cebff tempest-ProjectReaderTests-294031119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2212ec8c-dc14-4272-9f84-83d04e8cebff tempest-ProjectReaderTests-294031119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2212ec8c-dc14-4272-9f84-83d04e8cebff tempest-ProjectReaderTests-294031119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2212ec8c-dc14-4272-9f84-83d04e8cebff tempest-ProjectReaderTests-294031119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:18 devstack sudo[106632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:32:18 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0b896c92-368f-46b0-ba8f-c41cf9ed9395 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0b896c92-368f-46b0-ba8f-c41cf9ed9395 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0b896c92-368f-46b0-ba8f-c41cf9ed9395 tempest-ProjectMemberTests-864664885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-0b896c92-368f-46b0-ba8f-c41cf9ed9395 tempest-ProjectMemberTests-864664885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-0b896c92-368f-46b0-ba8f-c41cf9ed9395 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0b896c92-368f-46b0-ba8f-c41cf9ed9395 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:18 devstack sudo[106634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:32:18 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:18 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6ff7489e-e1f2-4a86-a484-4ffb8eafc76c tempest-CinderUnicodeTest-110830540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.c8456259-2ec2-48e3-9576-c3ce2395d437" returned: 0 in 0.514s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6ff7489e-e1f2-4a86-a484-4ffb8eafc76c tempest-CinderUnicodeTest-110830540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.c8456259-2ec2-48e3-9576-c3ce2395d437 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:18 devstack sudo[106636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.c8456259-2ec2-48e3-9576-c3ce2395d437
Sep 16 16:32:18 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:18 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2212ec8c-dc14-4272-9f84-83d04e8cebff tempest-ProjectReaderTests-294031119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.371s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-2212ec8c-dc14-4272-9f84-83d04e8cebff tempest-ProjectReaderTests-294031119 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:32:18 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-2212ec8c-dc14-4272-9f84-83d04e8cebff tempest-ProjectReaderTests-294031119 None] Deleted volume successfully.
Sep 16 16:32:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2212ec8c-dc14-4272-9f84-83d04e8cebff tempest-ProjectReaderTests-294031119 None] Lock "cinder-3876d08b-af86-4e1c-adce-77b16d75357e-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:19 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-0b896c92-368f-46b0-ba8f-c41cf9ed9395 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.378s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:19 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-0b896c92-368f-46b0-ba8f-c41cf9ed9395 tempest-ProjectMemberTests-864664885 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:32:19 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-0b896c92-368f-46b0-ba8f-c41cf9ed9395 tempest-ProjectMemberTests-864664885 None] Deleted volume successfully.
Sep 16 16:32:19 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-6ff7489e-e1f2-4a86-a484-4ffb8eafc76c tempest-CinderUnicodeTest-110830540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea.c8456259-2ec2-48e3-9576-c3ce2395d437" returned: 0 in 0.341s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-0b896c92-368f-46b0-ba8f-c41cf9ed9395 tempest-ProjectMemberTests-864664885 None] Lock "cinder-47c8b01e-3bb9-42dd-ac50-bbe87cc86ab0-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6ff7489e-e1f2-4a86-a484-4ffb8eafc76c tempest-CinderUnicodeTest-110830540 None] Lock "cinder-quobyte-c8456259-2ec2-48e3-9576-c3ce2395d437" released by "_delete_snapshot" :: held 2.094s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6ff7489e-e1f2-4a86-a484-4ffb8eafc76c tempest-CinderUnicodeTest-110830540 None] Lock "cinder-quobyte-f4611ad9-a01f-4d41-b068-bd16739651ea" released by "delete_snapshot" :: held 2.154s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:19 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-6ff7489e-e1f2-4a86-a484-4ffb8eafc76c tempest-CinderUnicodeTest-110830540 None] Created reservations ['4a01466d-4790-4146-b749-4021ef89e6ed', '5ba2a391-90bc-4b67-9383-ecf8bf805972', '8e1a6430-b7d9-487e-a45c-63952a7b0f5b', '813248ce-b84d-44c6-a882-ce2d2660b6c1'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:19 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-6ff7489e-e1f2-4a86-a484-4ffb8eafc76c tempest-CinderUnicodeTest-110830540 None] Delete snapshot completed successfully.
Sep 16 16:32:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-6ff7489e-e1f2-4a86-a484-4ffb8eafc76c tempest-CinderUnicodeTest-110830540 None] Lock "cinder-c8456259-2ec2-48e3-9576-c3ce2395d437-delete_snapshot" released by "delete_snapshot" :: held 2.394s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b3109b50-1411-49e1-95b0-dfff7235cd29 tempest-CinderUnicodeTest-110830540 None] Acquiring lock "cinder-f4611ad9-a01f-4d41-b068-bd16739651ea-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b3109b50-1411-49e1-95b0-dfff7235cd29 tempest-CinderUnicodeTest-110830540 None] Lock "cinder-f4611ad9-a01f-4d41-b068-bd16739651ea-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b3109b50-1411-49e1-95b0-dfff7235cd29 tempest-CinderUnicodeTest-110830540 None] Acquiring lock "cinder-quobyte-f4611ad9-a01f-4d41-b068-bd16739651ea" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b3109b50-1411-49e1-95b0-dfff7235cd29 tempest-CinderUnicodeTest-110830540 None] Lock "cinder-quobyte-f4611ad9-a01f-4d41-b068-bd16739651ea" acquired by "delete_volume" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9743bb7c-bde8-4bf5-aebd-fd32eda8b667]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b3109b50-1411-49e1-95b0-dfff7235cd29 tempest-CinderUnicodeTest-110830540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Flow 'volume_create_manager' (f89b6283-c618-4662-9bc5-c82b9b21aeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb0391c-4d53-40fa-bd82-40cfb85c59fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:20 devstack sudo[106641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea
Sep 16 16:32:20 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb0391c-4d53-40fa-bd82-40cfb85c59fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1749820724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=218cddae-bd73-4105-9ee9-53d36e09a2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4be84013f847d4a2f15dde740a2536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:20Z,use_quota=True,user_id='ae825737116546298fd942e8502abe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef26efc6-324e-4b04-a1c7-7cd4ce1c4b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef26efc6-324e-4b04-a1c7-7cd4ce1c4b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ea23e7-f125-4c24-92f3-e98e3c15507d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4ea23e7-f125-4c24-92f3-e98e3c15507d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '218cddae-bd73-4105-9ee9-53d36e09a2fc', 'volume_name': 'volume-218cddae-bd73-4105-9ee9-53d36e09a2fc', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363d0a33-6d12-49cc-9df0-a23cf387751c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363d0a33-6d12-49cc-9df0-a23cf387751c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6da244a-6edc-4613-be29-d04d65b1c6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:20 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Volume 218cddae-bd73-4105-9ee9-53d36e09a2fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-218cddae-bd73-4105-9ee9-53d36e09a2fc', 'volume_size': 1}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1749820724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=218cddae-bd73-4105-9ee9-53d36e09a2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4be84013f847d4a2f15dde740a2536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:20Z,use_quota=True,user_id='ae825737116546298fd942e8502abe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Creating volume 218cddae-bd73-4105-9ee9-53d36e09a2fc {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:32:20 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:20 devstack sudo[106643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc 1073741824
Sep 16 16:32:20 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Flow 'volume_create_manager' (fc8c1ee0-a5a7-4d12-9923-0c972c99a7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841d2651-7d5e-48e1-a3b6-47a4f3ce52a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841d2651-7d5e-48e1-a3b6-47a4f3ce52a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1491479561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=719b6f61-54fc-4795-80ab-1ba0029f60b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2081234a0841ebb70dd376a2636466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:20Z,use_quota=True,user_id='6dd42f1fbabe4a4bbc5462522d3bcf8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6fbd2cc-447d-4f77-9d7f-113691823d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6fbd2cc-447d-4f77-9d7f-113691823d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edab653-6626-477b-b6f2-ca3785179fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edab653-6626-477b-b6f2-ca3785179fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '719b6f61-54fc-4795-80ab-1ba0029f60b2', 'volume_name': 'volume-719b6f61-54fc-4795-80ab-1ba0029f60b2', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b7f7bab-df37-437c-b103-cd32134ef012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b7f7bab-df37-437c-b103-cd32134ef012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61785c5d-3605-4da3-bb5d-1f86441eb478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:20 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Volume 719b6f61-54fc-4795-80ab-1ba0029f60b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-719b6f61-54fc-4795-80ab-1ba0029f60b2', 'volume_size': 1}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:20 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b3109b50-1411-49e1-95b0-dfff7235cd29 tempest-CinderUnicodeTest-110830540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea" returned: 0 in 0.512s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b3109b50-1411-49e1-95b0-dfff7235cd29 tempest-CinderUnicodeTest-110830540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:20 devstack sudo[106649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea
Sep 16 16:32:20 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:21 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b3109b50-1411-49e1-95b0-dfff7235cd29 tempest-CinderUnicodeTest-110830540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f4611ad9-a01f-4d41-b068-bd16739651ea" returned: 0 in 0.327s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b3109b50-1411-49e1-95b0-dfff7235cd29 tempest-CinderUnicodeTest-110830540 None] Lock "cinder-quobyte-f4611ad9-a01f-4d41-b068-bd16739651ea" released by "delete_volume" :: held 0.927s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:21 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc 1073741824" returned: 0 in 0.661s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-b3109b50-1411-49e1-95b0-dfff7235cd29 tempest-CinderUnicodeTest-110830540 None] Created reservations ['64dc0e2a-1584-4df1-8a13-93ad13a010e0', 'fb7dac89-f76f-4a75-87c8-e9bad4d36557', 'b37f359d-f481-4aa0-ac84-2bc549c507aa', '9d633fea-4e1f-412b-bbd8-5d127bd9ebc5'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:21 devstack sudo[106656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc
Sep 16 16:32:21 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b3109b50-1411-49e1-95b0-dfff7235cd29 tempest-CinderUnicodeTest-110830540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b3109b50-1411-49e1-95b0-dfff7235cd29 tempest-CinderUnicodeTest-110830540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b3109b50-1411-49e1-95b0-dfff7235cd29 tempest-CinderUnicodeTest-110830540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b3109b50-1411-49e1-95b0-dfff7235cd29 tempest-CinderUnicodeTest-110830540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b3109b50-1411-49e1-95b0-dfff7235cd29 tempest-CinderUnicodeTest-110830540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b3109b50-1411-49e1-95b0-dfff7235cd29 tempest-CinderUnicodeTest-110830540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:21 devstack sudo[106658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:32:21 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:21 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc" returned: 0 in 0.310s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.874s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1491479561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=719b6f61-54fc-4795-80ab-1ba0029f60b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b2081234a0841ebb70dd376a2636466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:20Z,use_quota=True,user_id='6dd42f1fbabe4a4bbc5462522d3bcf8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Creating volume 719b6f61-54fc-4795-80ab-1ba0029f60b2 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:32:21 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-719b6f61-54fc-4795-80ab-1ba0029f60b2 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6da244a-6edc-4613-be29-d04d65b1c6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-218cddae-bd73-4105-9ee9-53d36e09a2fc', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d63dd5-2338-4f5e-9373-3707819138e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:21 devstack sudo[106661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-719b6f61-54fc-4795-80ab-1ba0029f60b2 1073741824
Sep 16 16:32:21 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:21 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Volume volume-218cddae-bd73-4105-9ee9-53d36e09a2fc (218cddae-bd73-4105-9ee9-53d36e09a2fc): created successfully
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d63dd5-2338-4f5e-9373-3707819138e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Flow 'volume_create_manager' (f89b6283-c618-4662-9bc5-c82b9b21aeb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:21 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-70bc2460-b1e1-4bb7-8989-aa507e867537 tempest-ProjectMemberTests-864664885 None] Created volume successfully.
Sep 16 16:32:21 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b3109b50-1411-49e1-95b0-dfff7235cd29 tempest-CinderUnicodeTest-110830540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.334s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-b3109b50-1411-49e1-95b0-dfff7235cd29 tempest-CinderUnicodeTest-110830540 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:32:21 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b3109b50-1411-49e1-95b0-dfff7235cd29 tempest-CinderUnicodeTest-110830540 None] Deleted volume successfully.
Sep 16 16:32:21 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b3109b50-1411-49e1-95b0-dfff7235cd29 tempest-CinderUnicodeTest-110830540 None] Lock "cinder-f4611ad9-a01f-4d41-b068-bd16739651ea-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:22 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-719b6f61-54fc-4795-80ab-1ba0029f60b2 1073741824" returned: 0 in 0.633s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-719b6f61-54fc-4795-80ab-1ba0029f60b2 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:22 devstack sudo[106668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-719b6f61-54fc-4795-80ab-1ba0029f60b2
Sep 16 16:32:22 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d2ad567e-bde3-4319-ba73-2a103b846ef4 tempest-CinderUnicodeTest-110830540 None] Acquiring lock "cinder-79bd2460-db35-4f3c-88e5-cd77bb109b25-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d2ad567e-bde3-4319-ba73-2a103b846ef4 tempest-CinderUnicodeTest-110830540 None] Lock "cinder-79bd2460-db35-4f3c-88e5-cd77bb109b25-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a94ae35b-5eed-4eaf-a5e3-4f7d93c61f1d tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d2ad567e-bde3-4319-ba73-2a103b846ef4 tempest-CinderUnicodeTest-110830540 None] Acquiring lock "cinder-quobyte-79bd2460-db35-4f3c-88e5-cd77bb109b25" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d2ad567e-bde3-4319-ba73-2a103b846ef4 tempest-CinderUnicodeTest-110830540 None] Lock "cinder-quobyte-79bd2460-db35-4f3c-88e5-cd77bb109b25" acquired by "delete_volume" :: waited 0.021s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:22 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a71ffd7-8d39-4a0b-a4f8-1983472f9af6]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d2ad567e-bde3-4319-ba73-2a103b846ef4 tempest-CinderUnicodeTest-110830540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-79bd2460-db35-4f3c-88e5-cd77bb109b25 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:22 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-719b6f61-54fc-4795-80ab-1ba0029f60b2" returned: 0 in 0.369s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:32:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a94ae35b-5eed-4eaf-a5e3-4f7d93c61f1d tempest-ProjectMemberTests-864664885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.097s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-a94ae35b-5eed-4eaf-a5e3-4f7d93c61f1d tempest-ProjectMemberTests-864664885 None] Creating offline snapshot ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518 of volume 218cddae-bd73-4105-9ee9-53d36e09a2fc {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:32:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61785c5d-3605-4da3-bb5d-1f86441eb478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-719b6f61-54fc-4795-80ab-1ba0029f60b2', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db538dae-b699-417f-93b4-3bd9f29f3b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:22 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[766e5404-093a-4e56-9875-be6adeffb09d]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a94ae35b-5eed-4eaf-a5e3-4f7d93c61f1d tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:22 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Volume volume-719b6f61-54fc-4795-80ab-1ba0029f60b2 (719b6f61-54fc-4795-80ab-1ba0029f60b2): created successfully
Sep 16 16:32:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db538dae-b699-417f-93b4-3bd9f29f3b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Flow 'volume_create_manager' (fc8c1ee0-a5a7-4d12-9923-0c972c99a7a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:22 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-34f9aff6-680f-4e5e-8220-898db740e910 tempest-ProjectReaderTests-294031119 None] Created volume successfully.
Sep 16 16:32:22 devstack sudo[106671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-79bd2460-db35-4f3c-88e5-cd77bb109b25
Sep 16 16:32:22 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:22 devstack sudo[106672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc
Sep 16 16:32:22 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:23 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d2ad567e-bde3-4319-ba73-2a103b846ef4 tempest-CinderUnicodeTest-110830540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-79bd2460-db35-4f3c-88e5-cd77bb109b25" returned: 0 in 0.432s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d2ad567e-bde3-4319-ba73-2a103b846ef4 tempest-CinderUnicodeTest-110830540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-79bd2460-db35-4f3c-88e5-cd77bb109b25 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:23 devstack sudo[106680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-79bd2460-db35-4f3c-88e5-cd77bb109b25
Sep 16 16:32:23 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:23 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a94ae35b-5eed-4eaf-a5e3-4f7d93c61f1d tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc" returned: 0 in 0.448s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a94ae35b-5eed-4eaf-a5e3-4f7d93c61f1d tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:23 devstack sudo[106683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518 1G
Sep 16 16:32:23 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:23 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d2ad567e-bde3-4319-ba73-2a103b846ef4 tempest-CinderUnicodeTest-110830540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-79bd2460-db35-4f3c-88e5-cd77bb109b25" returned: 0 in 0.294s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d2ad567e-bde3-4319-ba73-2a103b846ef4 tempest-CinderUnicodeTest-110830540 None] Lock "cinder-quobyte-79bd2460-db35-4f3c-88e5-cd77bb109b25" released by "delete_volume" :: held 0.784s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:23 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-d2ad567e-bde3-4319-ba73-2a103b846ef4 tempest-CinderUnicodeTest-110830540 None] Created reservations ['33bcbb9d-42db-4c73-8092-ba6ca698e42e', '72f5604b-3030-401d-804e-5426d11005b9', '0be965f8-8644-418c-8bef-a4638bbb86a8', '0b99d447-e475-4916-82e5-195dc567a8a9'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-862f832a-3fad-4e81-ac0b-4a01f82a03f8 tempest-ProjectReaderTests-294031119 None] Acquiring lock "cinder-719b6f61-54fc-4795-80ab-1ba0029f60b2-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-862f832a-3fad-4e81-ac0b-4a01f82a03f8 tempest-ProjectReaderTests-294031119 None] Lock "cinder-719b6f61-54fc-4795-80ab-1ba0029f60b2-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-862f832a-3fad-4e81-ac0b-4a01f82a03f8 tempest-ProjectReaderTests-294031119 None] Acquiring lock "cinder-quobyte-719b6f61-54fc-4795-80ab-1ba0029f60b2" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:23 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-862f832a-3fad-4e81-ac0b-4a01f82a03f8 tempest-ProjectReaderTests-294031119 None] Lock "cinder-quobyte-719b6f61-54fc-4795-80ab-1ba0029f60b2" acquired by "delete_volume" :: waited 0.043s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d2ad567e-bde3-4319-ba73-2a103b846ef4 tempest-CinderUnicodeTest-110830540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d2ad567e-bde3-4319-ba73-2a103b846ef4 tempest-CinderUnicodeTest-110830540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d2ad567e-bde3-4319-ba73-2a103b846ef4 tempest-CinderUnicodeTest-110830540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-d2ad567e-bde3-4319-ba73-2a103b846ef4 tempest-CinderUnicodeTest-110830540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-d2ad567e-bde3-4319-ba73-2a103b846ef4 tempest-CinderUnicodeTest-110830540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d2ad567e-bde3-4319-ba73-2a103b846ef4 tempest-CinderUnicodeTest-110830540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:23 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e94aaf9-2cce-4e43-9602-b1279a993aa9]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-862f832a-3fad-4e81-ac0b-4a01f82a03f8 tempest-ProjectReaderTests-294031119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-719b6f61-54fc-4795-80ab-1ba0029f60b2 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:23 devstack sudo[106689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:32:23 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:23 devstack sudo[106690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-719b6f61-54fc-4795-80ab-1ba0029f60b2
Sep 16 16:32:23 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:23 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a94ae35b-5eed-4eaf-a5e3-4f7d93c61f1d tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518 1G" returned: 0 in 0.819s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a94ae35b-5eed-4eaf-a5e3-4f7d93c61f1d tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-218cddae-bd73-4105-9ee9-53d36e09a2fc -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:24 devstack sudo[106693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-218cddae-bd73-4105-9ee9-53d36e09a2fc -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518
Sep 16 16:32:24 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:24 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d2ad567e-bde3-4319-ba73-2a103b846ef4 tempest-CinderUnicodeTest-110830540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.629s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:24 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-d2ad567e-bde3-4319-ba73-2a103b846ef4 tempest-CinderUnicodeTest-110830540 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:32:24 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-d2ad567e-bde3-4319-ba73-2a103b846ef4 tempest-CinderUnicodeTest-110830540 None] Deleted volume successfully.
Sep 16 16:32:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d2ad567e-bde3-4319-ba73-2a103b846ef4 tempest-CinderUnicodeTest-110830540 None] Lock "cinder-79bd2460-db35-4f3c-88e5-cd77bb109b25-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:24 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-862f832a-3fad-4e81-ac0b-4a01f82a03f8 tempest-ProjectReaderTests-294031119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-719b6f61-54fc-4795-80ab-1ba0029f60b2" returned: 0 in 0.665s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-862f832a-3fad-4e81-ac0b-4a01f82a03f8 tempest-ProjectReaderTests-294031119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-719b6f61-54fc-4795-80ab-1ba0029f60b2 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:24 devstack sudo[106703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-719b6f61-54fc-4795-80ab-1ba0029f60b2
Sep 16 16:32:24 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:24 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a94ae35b-5eed-4eaf-a5e3-4f7d93c61f1d tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-218cddae-bd73-4105-9ee9-53d36e09a2fc -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518" returned: 0 in 0.459s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:24 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-a94ae35b-5eed-4eaf-a5e3-4f7d93c61f1d tempest-ProjectMemberTests-864664885 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518 is being set with open permissions: ugo+rw
Sep 16 16:32:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a94ae35b-5eed-4eaf-a5e3-4f7d93c61f1d tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:24 devstack sudo[106705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518
Sep 16 16:32:24 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:24 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-862f832a-3fad-4e81-ac0b-4a01f82a03f8 tempest-ProjectReaderTests-294031119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-719b6f61-54fc-4795-80ab-1ba0029f60b2" returned: 0 in 0.342s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:24 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a94ae35b-5eed-4eaf-a5e3-4f7d93c61f1d tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518" returned: 0 in 0.305s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-862f832a-3fad-4e81-ac0b-4a01f82a03f8 tempest-ProjectReaderTests-294031119 None] Lock "cinder-quobyte-719b6f61-54fc-4795-80ab-1ba0029f60b2" released by "delete_volume" :: held 1.128s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a94ae35b-5eed-4eaf-a5e3-4f7d93c61f1d tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:24 devstack sudo[106709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.info
Sep 16 16:32:24 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:24 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-862f832a-3fad-4e81-ac0b-4a01f82a03f8 tempest-ProjectReaderTests-294031119 None] Created reservations ['0f0fa4a7-6193-470e-967c-c4106387a40d', '43aa5a77-e9ef-4e36-9b74-75a35feea569', '41a6f8e6-e90e-4362-9224-6b4334de1a34', '4aabe3b5-84b9-4575-96f1-93f21a51be05'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-862f832a-3fad-4e81-ac0b-4a01f82a03f8 tempest-ProjectReaderTests-294031119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-862f832a-3fad-4e81-ac0b-4a01f82a03f8 tempest-ProjectReaderTests-294031119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-862f832a-3fad-4e81-ac0b-4a01f82a03f8 tempest-ProjectReaderTests-294031119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-862f832a-3fad-4e81-ac0b-4a01f82a03f8 tempest-ProjectReaderTests-294031119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-862f832a-3fad-4e81-ac0b-4a01f82a03f8 tempest-ProjectReaderTests-294031119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-862f832a-3fad-4e81-ac0b-4a01f82a03f8 tempest-ProjectReaderTests-294031119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:25 devstack sudo[106711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:32:25 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:25 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a94ae35b-5eed-4eaf-a5e3-4f7d93c61f1d tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.info" returned: 0 in 0.487s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:25 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-a94ae35b-5eed-4eaf-a5e3-4f7d93c61f1d tempest-ProjectMemberTests-864664885 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.info is being set with open permissions: ugo+rw
Sep 16 16:32:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a94ae35b-5eed-4eaf-a5e3-4f7d93c61f1d tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:25 devstack sudo[106714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.info
Sep 16 16:32:25 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:25 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-862f832a-3fad-4e81-ac0b-4a01f82a03f8 tempest-ProjectReaderTests-294031119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.440s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:25 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-862f832a-3fad-4e81-ac0b-4a01f82a03f8 tempest-ProjectReaderTests-294031119 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:32:25 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-862f832a-3fad-4e81-ac0b-4a01f82a03f8 tempest-ProjectReaderTests-294031119 None] Deleted volume successfully.
Sep 16 16:32:25 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-862f832a-3fad-4e81-ac0b-4a01f82a03f8 tempest-ProjectReaderTests-294031119 None] Lock "cinder-719b6f61-54fc-4795-80ab-1ba0029f60b2-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:25 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a94ae35b-5eed-4eaf-a5e3-4f7d93c61f1d tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.info" returned: 0 in 0.364s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a94ae35b-5eed-4eaf-a5e3-4f7d93c61f1d tempest-ProjectMemberTests-864664885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.023s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:25 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-a94ae35b-5eed-4eaf-a5e3-4f7d93c61f1d tempest-ProjectMemberTests-864664885 None] Create snapshot completed successfully
Sep 16 16:32:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bc7c9dec-dca1-48bd-9779-7eccb0768846 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bc7c9dec-dca1-48bd-9779-7eccb0768846 tempest-ProjectMemberTests-864664885 None] Lock "cinder-ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bc7c9dec-dca1-48bd-9779-7eccb0768846 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-218cddae-bd73-4105-9ee9-53d36e09a2fc" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bc7c9dec-dca1-48bd-9779-7eccb0768846 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-218cddae-bd73-4105-9ee9-53d36e09a2fc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bc7c9dec-dca1-48bd-9779-7eccb0768846 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bc7c9dec-dca1-48bd-9779-7eccb0768846 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:26 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-bc7c9dec-dca1-48bd-9779-7eccb0768846 tempest-ProjectMemberTests-864664885 None] Deleting offline snapshot ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518 of volume 218cddae-bd73-4105-9ee9-53d36e09a2fc {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:32:26 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-bc7c9dec-dca1-48bd-9779-7eccb0768846 tempest-ProjectMemberTests-864664885 None] snapshot_file for this snap is: volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:32:26 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b4a0e6-f2c4-4263-ab77-d021eb66a942]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bc7c9dec-dca1-48bd-9779-7eccb0768846 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:27 devstack sudo[106718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518
Sep 16 16:32:27 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:27 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bc7c9dec-dca1-48bd-9779-7eccb0768846 tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518" returned: 0 in 0.523s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-bc7c9dec-dca1-48bd-9779-7eccb0768846 tempest-ProjectMemberTests-864664885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-218cddae-bd73-4105-9ee9-53d36e09a2fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:32:27 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[08192823-617b-4968-b74e-0ed7bcd33e76]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bc7c9dec-dca1-48bd-9779-7eccb0768846 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:27 devstack sudo[106723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc
Sep 16 16:32:27 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:28 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bc7c9dec-dca1-48bd-9779-7eccb0768846 tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc" returned: 0 in 0.682s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bc7c9dec-dca1-48bd-9779-7eccb0768846 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:28 devstack sudo[106729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518
Sep 16 16:32:28 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:28 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bc7c9dec-dca1-48bd-9779-7eccb0768846 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518" returned: 0 in 0.475s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bc7c9dec-dca1-48bd-9779-7eccb0768846 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:28 devstack sudo[106734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518
Sep 16 16:32:28 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:29 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bc7c9dec-dca1-48bd-9779-7eccb0768846 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc.ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518" returned: 0 in 0.360s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bc7c9dec-dca1-48bd-9779-7eccb0768846 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518" released by "_delete_snapshot" :: held 2.214s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bc7c9dec-dca1-48bd-9779-7eccb0768846 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-218cddae-bd73-4105-9ee9-53d36e09a2fc" released by "delete_snapshot" :: held 2.250s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:29 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-bc7c9dec-dca1-48bd-9779-7eccb0768846 tempest-ProjectMemberTests-864664885 None] Created reservations ['0f5303ab-d486-4fbf-9151-94caa3b32d18', 'aa55162a-d200-4c83-b07b-dbb971bdd633', '83c58bc0-8d58-440e-8a76-24d79bc2d3cf', '6ed33afa-9596-4225-9d13-ba44ea1de7ba'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:29 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-bc7c9dec-dca1-48bd-9779-7eccb0768846 tempest-ProjectMemberTests-864664885 None] Delete snapshot completed successfully.
Sep 16 16:32:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-bc7c9dec-dca1-48bd-9779-7eccb0768846 tempest-ProjectMemberTests-864664885 None] Lock "cinder-ff6bbd59-b3a4-4b9e-a1ef-61b29ace0518-delete_snapshot" released by "delete_snapshot" :: held 2.444s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-50844437-6200-4b17-927e-1721da3210a5 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-218cddae-bd73-4105-9ee9-53d36e09a2fc-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-50844437-6200-4b17-927e-1721da3210a5 tempest-ProjectMemberTests-864664885 None] Lock "cinder-218cddae-bd73-4105-9ee9-53d36e09a2fc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-50844437-6200-4b17-927e-1721da3210a5 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-218cddae-bd73-4105-9ee9-53d36e09a2fc" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:30 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-50844437-6200-4b17-927e-1721da3210a5 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-218cddae-bd73-4105-9ee9-53d36e09a2fc" acquired by "delete_volume" :: waited 0.024s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:30 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ae8a82-e119-4202-be0f-8495f4688a4f]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-50844437-6200-4b17-927e-1721da3210a5 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:30 devstack sudo[106738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc
Sep 16 16:32:30 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:30 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-50844437-6200-4b17-927e-1721da3210a5 tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc" returned: 0 in 0.487s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-50844437-6200-4b17-927e-1721da3210a5 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:30 devstack sudo[106744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc
Sep 16 16:32:30 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:31 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-50844437-6200-4b17-927e-1721da3210a5 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-218cddae-bd73-4105-9ee9-53d36e09a2fc" returned: 0 in 0.289s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-50844437-6200-4b17-927e-1721da3210a5 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-218cddae-bd73-4105-9ee9-53d36e09a2fc" released by "delete_volume" :: held 0.885s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:31 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-50844437-6200-4b17-927e-1721da3210a5 tempest-ProjectMemberTests-864664885 None] Created reservations ['1fda645e-c38b-40ba-9d54-689754c8ab6b', '1a51a52e-c998-42de-88d5-6bdc876180f3', '81a5e44a-46b3-4f7f-a588-6eda48b03d5b', '6e69189d-2010-4294-b984-7a207150dfeb'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-50844437-6200-4b17-927e-1721da3210a5 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-50844437-6200-4b17-927e-1721da3210a5 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-50844437-6200-4b17-927e-1721da3210a5 tempest-ProjectMemberTests-864664885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-50844437-6200-4b17-927e-1721da3210a5 tempest-ProjectMemberTests-864664885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-50844437-6200-4b17-927e-1721da3210a5 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-50844437-6200-4b17-927e-1721da3210a5 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:31 devstack sudo[106748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:32:31 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:31 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-50844437-6200-4b17-927e-1721da3210a5 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.323s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:31 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-50844437-6200-4b17-927e-1721da3210a5 tempest-ProjectMemberTests-864664885 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:32:31 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-50844437-6200-4b17-927e-1721da3210a5 tempest-ProjectMemberTests-864664885 None] Deleted volume successfully.
Sep 16 16:32:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-50844437-6200-4b17-927e-1721da3210a5 tempest-ProjectMemberTests-864664885 None] Lock "cinder-218cddae-bd73-4105-9ee9-53d36e09a2fc-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Flow 'volume_create_manager' (a6c35db8-8c7b-42b1-b123-15f639df6b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf1760b4-b5f0-4355-8482-dc8757324b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf1760b4-b5f0-4355-8482-dc8757324b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141417347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe125b6-0500-4668-b2f4-390a74105164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4be84013f847d4a2f15dde740a2536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:33Z,use_quota=True,user_id='ae825737116546298fd942e8502abe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718914ea-0157-4b40-9fc5-15b95beaf967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718914ea-0157-4b40-9fc5-15b95beaf967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f1acf4-0d90-4eed-9d40-e799762d40de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f1acf4-0d90-4eed-9d40-e799762d40de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fe125b6-0500-4668-b2f4-390a74105164', 'volume_name': 'volume-5fe125b6-0500-4668-b2f4-390a74105164', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7e86dd-e51d-4242-b767-db8ab5ed0760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7e86dd-e51d-4242-b767-db8ab5ed0760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e893cdf-e3db-4dcf-95a4-ae4bc2d91183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:33 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Volume 5fe125b6-0500-4668-b2f4-390a74105164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fe125b6-0500-4668-b2f4-390a74105164', 'volume_size': 1}
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141417347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe125b6-0500-4668-b2f4-390a74105164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4be84013f847d4a2f15dde740a2536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:33Z,use_quota=True,user_id='ae825737116546298fd942e8502abe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Creating volume 5fe125b6-0500-4668-b2f4-390a74105164 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:32:33 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:33 devstack sudo[106751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164 1073741824
Sep 16 16:32:33 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:33 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164 1073741824" returned: 0 in 0.625s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:33 devstack sudo[106757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:32:33 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:33 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Flow 'volume_create_manager' (a428f901-d4cb-4c3e-a006-7478bdf6f87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a462f57-2167-4949-b589-6b22514224be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a462f57-2167-4949-b589-6b22514224be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-913692556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3807066a-3adc-4890-9004-cec255d00d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ae7115221e468bb7c8f73ce6690346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:34Z,use_quota=True,user_id='3620251502fa4f95859624111b3a8a6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00733ac7-1f73-49b5-b9e3-fbadf8fe039c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00733ac7-1f73-49b5-b9e3-fbadf8fe039c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeab35d5-872b-4c57-82c6-03033f239a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeab35d5-872b-4c57-82c6-03033f239a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3807066a-3adc-4890-9004-cec255d00d93', 'volume_name': 'volume-3807066a-3adc-4890-9004-cec255d00d93', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd14eefd-06f9-4361-ac7c-a01ff8c01240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd14eefd-06f9-4361-ac7c-a01ff8c01240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31f5676-65bc-4c4a-ab84-9b3f97ddc61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:34 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Volume 3807066a-3adc-4890-9004-cec255d00d93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3807066a-3adc-4890-9004-cec255d00d93', 'volume_size': 1}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:34 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164" returned: 0 in 0.317s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.178s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-913692556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3807066a-3adc-4890-9004-cec255d00d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ae7115221e468bb7c8f73ce6690346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:34Z,use_quota=True,user_id='3620251502fa4f95859624111b3a8a6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Creating volume 3807066a-3adc-4890-9004-cec255d00d93 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:32:34 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:34 devstack sudo[106760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93 1073741824
Sep 16 16:32:34 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e893cdf-e3db-4dcf-95a4-ae4bc2d91183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fe125b6-0500-4668-b2f4-390a74105164', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4a5c3d-6fa1-4ac4-8533-dde74a3a452a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:34 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Volume volume-5fe125b6-0500-4668-b2f4-390a74105164 (5fe125b6-0500-4668-b2f4-390a74105164): created successfully
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4a5c3d-6fa1-4ac4-8533-dde74a3a452a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Flow 'volume_create_manager' (a6c35db8-8c7b-42b1-b123-15f639df6b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:34 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-3b50822c-4504-4b22-bed3-8333e75619c6 tempest-ProjectMemberTests-864664885 None] Created volume successfully.
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e9ce730a-4462-4761-93de-765f5e095a7c tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:34 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93 1073741824" returned: 0 in 0.653s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:34 devstack sudo[106766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93
Sep 16 16:32:34 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:35 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93" returned: 0 in 0.271s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:32:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e9ce730a-4462-4761-93de-765f5e095a7c tempest-ProjectMemberTests-864664885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.535s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31f5676-65bc-4c4a-ab84-9b3f97ddc61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3807066a-3adc-4890-9004-cec255d00d93', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530dc7ef-5b11-4755-a4b6-24be21263ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:35 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-e9ce730a-4462-4761-93de-765f5e095a7c tempest-ProjectMemberTests-864664885 None] Creating offline snapshot c7eb52fc-e615-4cc0-9870-04953f0387a5 of volume 5fe125b6-0500-4668-b2f4-390a74105164 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:32:35 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Volume volume-3807066a-3adc-4890-9004-cec255d00d93 (3807066a-3adc-4890-9004-cec255d00d93): created successfully
Sep 16 16:32:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530dc7ef-5b11-4755-a4b6-24be21263ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:35 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Flow 'volume_create_manager' (a428f901-d4cb-4c3e-a006-7478bdf6f87c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:35 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aee5b88-c247-4810-ae32-e085d8d56ed6]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9ce730a-4462-4761-93de-765f5e095a7c tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:35 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-bee84f83-5324-4c12-88c1-d36511fa7a1f tempest-SnapshotDependencyTests-1109607946 None] Created volume successfully.
Sep 16 16:32:35 devstack sudo[106769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164
Sep 16 16:32:35 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:35 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9ce730a-4462-4761-93de-765f5e095a7c tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164" returned: 0 in 0.418s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9ce730a-4462-4761-93de-765f5e095a7c tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.c7eb52fc-e615-4cc0-9870-04953f0387a5 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:35 devstack sudo[106774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.c7eb52fc-e615-4cc0-9870-04953f0387a5 1G
Sep 16 16:32:35 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:36 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9ce730a-4462-4761-93de-765f5e095a7c tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.c7eb52fc-e615-4cc0-9870-04953f0387a5 1G" returned: 0 in 0.554s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9ce730a-4462-4761-93de-765f5e095a7c tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fe125b6-0500-4668-b2f4-390a74105164 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.c7eb52fc-e615-4cc0-9870-04953f0387a5 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:36 devstack sudo[106780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fe125b6-0500-4668-b2f4-390a74105164 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.c7eb52fc-e615-4cc0-9870-04953f0387a5
Sep 16 16:32:36 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2c91904f-ffc6-4514-a0ad-178da17d7066 tempest-SnapshotDependencyTests-1109607946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:36 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:32:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Flow 'volume_create_manager' (35cf3ae7-259a-4ff2-904d-bcb77958ec10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14126ace-3596-4f0f-b6e6-b9bd5e8670ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14126ace-3596-4f0f-b6e6-b9bd5e8670ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-572722869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e75b8fa-8c76-475f-ae32-427907ef776f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f21e422bf24b959140b013ddc9f55c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:37Z,use_quota=True,user_id='5e74c6be511f44b59a2cf5e55f725d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1538d655-1b55-48cb-af62-b7cb98903645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1538d655-1b55-48cb-af62-b7cb98903645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f7ac28c-9d70-4111-ab39-d0fafa1f08ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:36 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f7ac28c-9d70-4111-ab39-d0fafa1f08ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e75b8fa-8c76-475f-ae32-427907ef776f', 'volume_name': 'volume-1e75b8fa-8c76-475f-ae32-427907ef776f', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd8625f-86ce-41b0-8ca0-ca2dc9edffbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd8625f-86ce-41b0-8ca0-ca2dc9edffbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:36 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef9a276-9955-4629-a1f5-6e9a49e0f418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:36 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Volume 1e75b8fa-8c76-475f-ae32-427907ef776f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e75b8fa-8c76-475f-ae32-427907ef776f', 'volume_size': 1}
Sep 16 16:32:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9ce730a-4462-4761-93de-765f5e095a7c tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fe125b6-0500-4668-b2f4-390a74105164 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.c7eb52fc-e615-4cc0-9870-04953f0387a5" returned: 0 in 0.411s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:36 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-e9ce730a-4462-4761-93de-765f5e095a7c tempest-ProjectMemberTests-864664885 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.c7eb52fc-e615-4cc0-9870-04953f0387a5 is being set with open permissions: ugo+rw
Sep 16 16:32:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9ce730a-4462-4761-93de-765f5e095a7c tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.c7eb52fc-e615-4cc0-9870-04953f0387a5 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:36 devstack sudo[106786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.c7eb52fc-e615-4cc0-9870-04953f0387a5
Sep 16 16:32:36 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:36 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9ce730a-4462-4761-93de-765f5e095a7c tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.c7eb52fc-e615-4cc0-9870-04953f0387a5" returned: 0 in 0.278s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9ce730a-4462-4761-93de-765f5e095a7c tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:37 devstack sudo[106790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.info
Sep 16 16:32:37 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:37 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9ce730a-4462-4761-93de-765f5e095a7c tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.info" returned: 0 in 0.266s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:37 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-e9ce730a-4462-4761-93de-765f5e095a7c tempest-ProjectMemberTests-864664885 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.info is being set with open permissions: ugo+rw
Sep 16 16:32:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9ce730a-4462-4761-93de-765f5e095a7c tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:37 devstack sudo[106793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.info
Sep 16 16:32:37 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:37 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e9ce730a-4462-4761-93de-765f5e095a7c tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.info" returned: 0 in 0.245s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e9ce730a-4462-4761-93de-765f5e095a7c tempest-ProjectMemberTests-864664885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.384s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2c91904f-ffc6-4514-a0ad-178da17d7066 tempest-SnapshotDependencyTests-1109607946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.085s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-2c91904f-ffc6-4514-a0ad-178da17d7066 tempest-SnapshotDependencyTests-1109607946 None] Creating offline snapshot 128be1ab-7049-440e-a60f-66a5a9e6ce29 of volume 3807066a-3adc-4890-9004-cec255d00d93 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:32:37 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-e9ce730a-4462-4761-93de-765f5e095a7c tempest-ProjectMemberTests-864664885 None] Create snapshot completed successfully
Sep 16 16:32:37 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee4a013-8eb7-48d6-97bb-1450d3e861f4]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c91904f-ffc6-4514-a0ad-178da17d7066 tempest-SnapshotDependencyTests-1109607946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:37 devstack sudo[106796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93
Sep 16 16:32:37 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-91ee0472-9321-4529-bf59-dfcf14255ff2 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-c7eb52fc-e615-4cc0-9870-04953f0387a5-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-91ee0472-9321-4529-bf59-dfcf14255ff2 tempest-ProjectMemberTests-864664885 None] Lock "cinder-c7eb52fc-e615-4cc0-9870-04953f0387a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-91ee0472-9321-4529-bf59-dfcf14255ff2 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-5fe125b6-0500-4668-b2f4-390a74105164" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-91ee0472-9321-4529-bf59-dfcf14255ff2 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-5fe125b6-0500-4668-b2f4-390a74105164" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-91ee0472-9321-4529-bf59-dfcf14255ff2 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-c7eb52fc-e615-4cc0-9870-04953f0387a5" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-91ee0472-9321-4529-bf59-dfcf14255ff2 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-c7eb52fc-e615-4cc0-9870-04953f0387a5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-91ee0472-9321-4529-bf59-dfcf14255ff2 tempest-ProjectMemberTests-864664885 None] Deleting offline snapshot c7eb52fc-e615-4cc0-9870-04953f0387a5 of volume 5fe125b6-0500-4668-b2f4-390a74105164 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:32:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-91ee0472-9321-4529-bf59-dfcf14255ff2 tempest-ProjectMemberTests-864664885 None] snapshot_file for this snap is: volume-5fe125b6-0500-4668-b2f4-390a74105164.c7eb52fc-e615-4cc0-9870-04953f0387a5 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:32:37 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6e0b39-859d-4e3d-9b64-d604d9d1c82a]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-91ee0472-9321-4529-bf59-dfcf14255ff2 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.c7eb52fc-e615-4cc0-9870-04953f0387a5 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:38 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c91904f-ffc6-4514-a0ad-178da17d7066 tempest-SnapshotDependencyTests-1109607946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93" returned: 0 in 0.399s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c91904f-ffc6-4514-a0ad-178da17d7066 tempest-SnapshotDependencyTests-1109607946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:38 devstack sudo[106802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29 1G
Sep 16 16:32:38 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:38 devstack sudo[106800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.c7eb52fc-e615-4cc0-9870-04953f0387a5
Sep 16 16:32:38 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:38 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-91ee0472-9321-4529-bf59-dfcf14255ff2 tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.c7eb52fc-e615-4cc0-9870-04953f0387a5" returned: 0 in 0.389s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:38 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-91ee0472-9321-4529-bf59-dfcf14255ff2 tempest-ProjectMemberTests-864664885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fe125b6-0500-4668-b2f4-390a74105164(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:32:38 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e23525e-f5fb-4458-afe2-75ea524e9b71]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-91ee0472-9321-4529-bf59-dfcf14255ff2 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:38 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:38 devstack sudo[106811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164
Sep 16 16:32:38 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c91904f-ffc6-4514-a0ad-178da17d7066 tempest-SnapshotDependencyTests-1109607946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29 1G" returned: 0 in 0.478s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c91904f-ffc6-4514-a0ad-178da17d7066 tempest-SnapshotDependencyTests-1109607946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3807066a-3adc-4890-9004-cec255d00d93 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:38 devstack sudo[106814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3807066a-3adc-4890-9004-cec255d00d93 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29
Sep 16 16:32:38 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:38 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-91ee0472-9321-4529-bf59-dfcf14255ff2 tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164" returned: 0 in 0.425s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-91ee0472-9321-4529-bf59-dfcf14255ff2 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.c7eb52fc-e615-4cc0-9870-04953f0387a5 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:38 devstack sudo[106823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.c7eb52fc-e615-4cc0-9870-04953f0387a5
Sep 16 16:32:38 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:38 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c91904f-ffc6-4514-a0ad-178da17d7066 tempest-SnapshotDependencyTests-1109607946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3807066a-3adc-4890-9004-cec255d00d93 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29" returned: 0 in 0.327s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:38 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-2c91904f-ffc6-4514-a0ad-178da17d7066 tempest-SnapshotDependencyTests-1109607946 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29 is being set with open permissions: ugo+rw
Sep 16 16:32:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c91904f-ffc6-4514-a0ad-178da17d7066 tempest-SnapshotDependencyTests-1109607946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:38 devstack sudo[106825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29
Sep 16 16:32:38 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:39 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c91904f-ffc6-4514-a0ad-178da17d7066 tempest-SnapshotDependencyTests-1109607946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29" returned: 0 in 0.255s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c91904f-ffc6-4514-a0ad-178da17d7066 tempest-SnapshotDependencyTests-1109607946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:39 devstack sudo[106832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.info
Sep 16 16:32:39 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:39 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-91ee0472-9321-4529-bf59-dfcf14255ff2 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.c7eb52fc-e615-4cc0-9870-04953f0387a5" returned: 0 in 0.388s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-91ee0472-9321-4529-bf59-dfcf14255ff2 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.c7eb52fc-e615-4cc0-9870-04953f0387a5 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:39 devstack sudo[106834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.c7eb52fc-e615-4cc0-9870-04953f0387a5
Sep 16 16:32:39 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:39 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c91904f-ffc6-4514-a0ad-178da17d7066 tempest-SnapshotDependencyTests-1109607946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.info" returned: 0 in 0.292s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:39 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-2c91904f-ffc6-4514-a0ad-178da17d7066 tempest-SnapshotDependencyTests-1109607946 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.info is being set with open permissions: ugo+rw
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c91904f-ffc6-4514-a0ad-178da17d7066 tempest-SnapshotDependencyTests-1109607946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:39 devstack sudo[106839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.info
Sep 16 16:32:39 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:39 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-91ee0472-9321-4529-bf59-dfcf14255ff2 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164.c7eb52fc-e615-4cc0-9870-04953f0387a5" returned: 0 in 0.304s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-91ee0472-9321-4529-bf59-dfcf14255ff2 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-c7eb52fc-e615-4cc0-9870-04953f0387a5" released by "_delete_snapshot" :: held 1.627s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-91ee0472-9321-4529-bf59-dfcf14255ff2 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-5fe125b6-0500-4668-b2f4-390a74105164" released by "delete_snapshot" :: held 1.655s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-91ee0472-9321-4529-bf59-dfcf14255ff2 tempest-ProjectMemberTests-864664885 None] Created reservations ['276eb64f-4e68-46b4-8210-5f481d027162', 'ff6e9dbc-4ebb-4455-be86-b8cc3ba947d3', '953b42f0-bd88-4e0c-abb9-16da8449a863', 'e73c6271-3e57-462b-9a30-db5eae524934'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:39 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-91ee0472-9321-4529-bf59-dfcf14255ff2 tempest-ProjectMemberTests-864664885 None] Delete snapshot completed successfully.
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-91ee0472-9321-4529-bf59-dfcf14255ff2 tempest-ProjectMemberTests-864664885 None] Lock "cinder-c7eb52fc-e615-4cc0-9870-04953f0387a5-delete_snapshot" released by "delete_snapshot" :: held 1.816s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:39 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2c91904f-ffc6-4514-a0ad-178da17d7066 tempest-SnapshotDependencyTests-1109607946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.info" returned: 0 in 0.303s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2c91904f-ffc6-4514-a0ad-178da17d7066 tempest-SnapshotDependencyTests-1109607946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.167s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.105s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-572722869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e75b8fa-8c76-475f-ae32-427907ef776f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f21e422bf24b959140b013ddc9f55c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:37Z,use_quota=True,user_id='5e74c6be511f44b59a2cf5e55f725d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Creating volume 1e75b8fa-8c76-475f-ae32-427907ef776f {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:32:39 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:32:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:39 devstack sudo[106843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f 1073741824
Sep 16 16:32:39 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:39 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-2c91904f-ffc6-4514-a0ad-178da17d7066 tempest-SnapshotDependencyTests-1109607946 None] Create snapshot completed successfully
Sep 16 16:32:40 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-394c0cc9-8ef5-4fb8-87e3-12795f0bc5f7 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-5fe125b6-0500-4668-b2f4-390a74105164-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:40 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-394c0cc9-8ef5-4fb8-87e3-12795f0bc5f7 tempest-ProjectMemberTests-864664885 None] Lock "cinder-5fe125b6-0500-4668-b2f4-390a74105164-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:40 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-394c0cc9-8ef5-4fb8-87e3-12795f0bc5f7 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-5fe125b6-0500-4668-b2f4-390a74105164" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:40 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-394c0cc9-8ef5-4fb8-87e3-12795f0bc5f7 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-5fe125b6-0500-4668-b2f4-390a74105164" acquired by "delete_volume" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:40 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef40f053-4084-4f1a-b19b-54c275a50be1]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-394c0cc9-8ef5-4fb8-87e3-12795f0bc5f7 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:40 devstack sudo[106848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164
Sep 16 16:32:40 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:40 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f 1073741824" returned: 0 in 0.560s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:40 devstack sudo[106850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f
Sep 16 16:32:40 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:40 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-394c0cc9-8ef5-4fb8-87e3-12795f0bc5f7 tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164" returned: 0 in 0.449s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-394c0cc9-8ef5-4fb8-87e3-12795f0bc5f7 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:40 devstack sudo[106857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164
Sep 16 16:32:40 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:40 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f" returned: 0 in 0.323s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:40 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:32:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef9a276-9955-4629-a1f5-6e9a49e0f418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e75b8fa-8c76-475f-ae32-427907ef776f', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f54ec6-a188-40ed-bf2d-ab82b7cc3df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:40 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Volume volume-1e75b8fa-8c76-475f-ae32-427907ef776f (1e75b8fa-8c76-475f-ae32-427907ef776f): created successfully
Sep 16 16:32:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f54ec6-a188-40ed-bf2d-ab82b7cc3df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:40 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Flow 'volume_create_manager' (35cf3ae7-259a-4ff2-904d-bcb77958ec10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:40 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-687757d4-3b8e-41ba-9440-4854c0c93e31 tempest-ProjectReaderTests-1980496335 None] Created volume successfully.
Sep 16 16:32:40 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:40 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-394c0cc9-8ef5-4fb8-87e3-12795f0bc5f7 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-5fe125b6-0500-4668-b2f4-390a74105164" returned: 0 in 0.316s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-394c0cc9-8ef5-4fb8-87e3-12795f0bc5f7 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-5fe125b6-0500-4668-b2f4-390a74105164" released by "delete_volume" :: held 0.848s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-394c0cc9-8ef5-4fb8-87e3-12795f0bc5f7 tempest-ProjectMemberTests-864664885 None] Created reservations ['30f219eb-8563-4129-986a-e89c9d594ac5', '770f306f-f9c9-4ea8-9eab-5010e75a1bfe', 'ea1fbb19-16d4-47e3-9555-09561b9568e4', 'cbb2d175-44af-4e01-a0ae-aa53dcdfff48'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-394c0cc9-8ef5-4fb8-87e3-12795f0bc5f7 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-394c0cc9-8ef5-4fb8-87e3-12795f0bc5f7 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-394c0cc9-8ef5-4fb8-87e3-12795f0bc5f7 tempest-ProjectMemberTests-864664885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-394c0cc9-8ef5-4fb8-87e3-12795f0bc5f7 tempest-ProjectMemberTests-864664885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-394c0cc9-8ef5-4fb8-87e3-12795f0bc5f7 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-394c0cc9-8ef5-4fb8-87e3-12795f0bc5f7 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:41 devstack sudo[106861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:32:41 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Flow 'volume_create_manager' (699936a2-139e-4e08-ae7a-aa1ca2a1f3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b7b856-9c03-4d02-95b0-1a940794515a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b7b856-9c03-4d02-95b0-1a940794515a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50af31a9-9117-4a00-84db-25d8fb7de7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ae7115221e468bb7c8f73ce6690346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=128be1ab-7049-440e-a60f-66a5a9e6ce29,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:41Z,use_quota=True,user_id='3620251502fa4f95859624111b3a8a6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093f978b-ce01-4a74-b3c5-e37106d22814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093f978b-ce01-4a74-b3c5-e37106d22814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec6bf97-c19b-4f59-9732-ca6144cf12fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec6bf97-c19b-4f59-9732-ca6144cf12fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '50af31a9-9117-4a00-84db-25d8fb7de7e7', 'volume_name': 'volume-50af31a9-9117-4a00-84db-25d8fb7de7e7', 'volume_size': 1, 'snapshot_id': '128be1ab-7049-440e-a60f-66a5a9e6ce29'}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dfdb89e-a6ce-4086-843a-bce67ed213f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dfdb89e-a6ce-4086-843a-bce67ed213f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd2b2a9-ebbb-4734-bdbb-e424c977bed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:41 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Volume 50af31a9-9117-4a00-84db-25d8fb7de7e7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-50af31a9-9117-4a00-84db-25d8fb7de7e7', 'volume_size': 1, 'snapshot_id': '128be1ab-7049-440e-a60f-66a5a9e6ce29'}
Sep 16 16:32:41 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Acquiring lock "cinder-quobyte-128be1ab-7049-440e-a60f-66a5a9e6ce29-50af31a9-9117-4a00-84db-25d8fb7de7e7" by "_create_volume_from_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-394c0cc9-8ef5-4fb8-87e3-12795f0bc5f7 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.283s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-394c0cc9-8ef5-4fb8-87e3-12795f0bc5f7 tempest-ProjectMemberTests-864664885 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:32:41 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-394c0cc9-8ef5-4fb8-87e3-12795f0bc5f7 tempest-ProjectMemberTests-864664885 None] Deleted volume successfully.
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Lock "cinder-quobyte-128be1ab-7049-440e-a60f-66a5a9e6ce29-50af31a9-9117-4a00-84db-25d8fb7de7e7" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Creating volume 50af31a9-9117-4a00-84db-25d8fb7de7e7 from snapshot 128be1ab-7049-440e-a60f-66a5a9e6ce29 {{(pid=86165) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Acquiring lock "cinder-quobyte-50af31a9-9117-4a00-84db-25d8fb7de7e7" by "_copy_volume_from_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-394c0cc9-8ef5-4fb8-87e3-12795f0bc5f7 tempest-ProjectMemberTests-864664885 None] Lock "cinder-5fe125b6-0500-4668-b2f4-390a74105164-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Lock "cinder-quobyte-50af31a9-9117-4a00-84db-25d8fb7de7e7" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] snapshot: 128be1ab-7049-440e-a60f-66a5a9e6ce29, volume: 50af31a9-9117-4a00-84db-25d8fb7de7e7,  {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ea3345-fae9-4393-adea-e5255aad72e4]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:41 devstack sudo[106864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29
Sep 16 16:32:41 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:41 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:32:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Flow 'volume_create_manager' (04b28dc1-7116-4004-aa7d-bb0a1f7019b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11efce41-62e5-4edc-b1e5-5d9e3394a27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11efce41-62e5-4edc-b1e5-5d9e3394a27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-521433958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1bc999-960e-4331-b091-bf6a8296f788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4be84013f847d4a2f15dde740a2536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:42Z,use_quota=True,user_id='ae825737116546298fd942e8502abe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce75ad3-a53d-4a61-92d6-e778871e5950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce75ad3-a53d-4a61-92d6-e778871e5950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d65199-1a0e-4d9e-96d8-4eb437054167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d65199-1a0e-4d9e-96d8-4eb437054167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c1bc999-960e-4331-b091-bf6a8296f788', 'volume_name': 'volume-0c1bc999-960e-4331-b091-bf6a8296f788', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a63d628-4736-4c84-8dd8-080a412eecf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a63d628-4736-4c84-8dd8-080a412eecf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:42 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9344a4-6f52-4720-a8fd-44c596774c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:42 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Volume 0c1bc999-960e-4331-b091-bf6a8296f788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c1bc999-960e-4331-b091-bf6a8296f788', 'volume_size': 1}
Sep 16 16:32:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:42 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-42ff47cf-27bb-49b9-a383-aa63f04af7de tempest-ProjectReaderTests-1980496335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29" returned: 0 in 0.536s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:42 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3807066a-3adc-4890-9004-cec255d00d93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:32:42 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f1e3b4-5873-4608-b79b-4281ad653f4e]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:42 devstack sudo[106870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93
Sep 16 16:32:42 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:42 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93" returned: 0 in 0.411s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:42 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] will copy from snapshot at /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93 {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 16 16:32:42 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Creating direct copy from snapshot {{(pid=86165) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 16 16:32:42 devstack cinder-volume[86165]: DEBUG cinder.utils [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Path /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-50af31a9-9117-4a00-84db-25d8fb7de7e7 not found in is_blk_device check {{(pid=86165) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 16 16:32:42 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-50af31a9-9117-4a00-84db-25d8fb7de7e7 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:42 devstack sudo[106875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-50af31a9-9117-4a00-84db-25d8fb7de7e7
Sep 16 16:32:42 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:48 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-50af31a9-9117-4a00-84db-25d8fb7de7e7" returned: 0 in 6.039s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:48 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Image conversion details: src /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-50af31a9-9117-4a00-84db-25d8fb7de7e7 {{(pid=86165) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 16 16:32:48 devstack cinder-volume[86165]: INFO cinder.image.image_utils [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Converted 1024.00 MB image at 169.52 MB/s
Sep 16 16:32:48 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-50af31a9-9117-4a00-84db-25d8fb7de7e7 is being set with open permissions: ugo+rw
Sep 16 16:32:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-50af31a9-9117-4a00-84db-25d8fb7de7e7 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:48 devstack sudo[106888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-50af31a9-9117-4a00-84db-25d8fb7de7e7
Sep 16 16:32:48 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:48 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-50af31a9-9117-4a00-84db-25d8fb7de7e7" returned: 0 in 0.240s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Lock "cinder-quobyte-50af31a9-9117-4a00-84db-25d8fb7de7e7" released by "_copy_volume_from_snapshot" :: held 7.328s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Lock "cinder-quobyte-128be1ab-7049-440e-a60f-66a5a9e6ce29-50af31a9-9117-4a00-84db-25d8fb7de7e7" released by "_create_volume_from_snapshot" :: held 7.402s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.431s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.791s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-521433958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1bc999-960e-4331-b091-bf6a8296f788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4be84013f847d4a2f15dde740a2536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:42Z,use_quota=True,user_id='ae825737116546298fd942e8502abe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:32:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Creating volume 0c1bc999-960e-4331-b091-bf6a8296f788 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:32:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:32:48 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:32:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:48 devstack sudo[106891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788 1073741824
Sep 16 16:32:48 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd2b2a9-ebbb-4734-bdbb-e424c977bed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50af31a9-9117-4a00-84db-25d8fb7de7e7', 'volume_size': 1, 'snapshot_id': '128be1ab-7049-440e-a60f-66a5a9e6ce29'}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f821e7c0-780b-4d3c-8542-153648a69a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:48 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Volume volume-50af31a9-9117-4a00-84db-25d8fb7de7e7 (50af31a9-9117-4a00-84db-25d8fb7de7e7): created successfully
Sep 16 16:32:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f821e7c0-780b-4d3c-8542-153648a69a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Flow 'volume_create_manager' (699936a2-139e-4e08-ae7a-aa1ca2a1f3fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:48 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-2d357790-ea02-4a9c-81ea-e8f640799db3 tempest-SnapshotDependencyTests-1109607946 None] Created volume successfully.
Sep 16 16:32:49 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788 1073741824" returned: 0 in 0.429s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:49 devstack sudo[106897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788
Sep 16 16:32:49 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:49 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788" returned: 0 in 0.245s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:32:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-42ff47cf-27bb-49b9-a383-aa63f04af7de tempest-ProjectReaderTests-1980496335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.478s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a9344a4-6f52-4720-a8fd-44c596774c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c1bc999-960e-4331-b091-bf6a8296f788', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dcd1e56-03c8-4df9-ae35-94324004e2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-42ff47cf-27bb-49b9-a383-aa63f04af7de tempest-ProjectReaderTests-1980496335 None] Creating offline snapshot 1437ee6f-ff9f-4384-9e6d-d5c4cac6c496 of volume 1e75b8fa-8c76-475f-ae32-427907ef776f {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:32:49 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Volume volume-0c1bc999-960e-4331-b091-bf6a8296f788 (0c1bc999-960e-4331-b091-bf6a8296f788): created successfully
Sep 16 16:32:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dcd1e56-03c8-4df9-ae35-94324004e2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:49 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Flow 'volume_create_manager' (04b28dc1-7116-4004-aa7d-bb0a1f7019b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:49 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0db1cb-1445-4ab9-99e7-dfafc79c0eab]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42ff47cf-27bb-49b9-a383-aa63f04af7de tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:49 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-e8518a9d-9cd5-4892-98ed-593e7c816fc5 tempest-ProjectMemberTests-864664885 None] Created volume successfully.
Sep 16 16:32:49 devstack sudo[106900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f
Sep 16 16:32:49 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-39832049-a7db-4f82-937e-87ecd746d3c7 tempest-SnapshotDependencyTests-1109607946 None] Acquiring lock "cinder-128be1ab-7049-440e-a60f-66a5a9e6ce29-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-39832049-a7db-4f82-937e-87ecd746d3c7 tempest-SnapshotDependencyTests-1109607946 None] Lock "cinder-128be1ab-7049-440e-a60f-66a5a9e6ce29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-39832049-a7db-4f82-937e-87ecd746d3c7 tempest-SnapshotDependencyTests-1109607946 None] Acquiring lock "cinder-quobyte-3807066a-3adc-4890-9004-cec255d00d93" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:50 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42ff47cf-27bb-49b9-a383-aa63f04af7de tempest-ProjectReaderTests-1980496335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f" returned: 0 in 0.387s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42ff47cf-27bb-49b9-a383-aa63f04af7de tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.1437ee6f-ff9f-4384-9e6d-d5c4cac6c496 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-39832049-a7db-4f82-937e-87ecd746d3c7 tempest-SnapshotDependencyTests-1109607946 None] Lock "cinder-quobyte-3807066a-3adc-4890-9004-cec255d00d93" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-39832049-a7db-4f82-937e-87ecd746d3c7 tempest-SnapshotDependencyTests-1109607946 None] Acquiring lock "cinder-quobyte-128be1ab-7049-440e-a60f-66a5a9e6ce29" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:50 devstack sudo[106905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.1437ee6f-ff9f-4384-9e6d-d5c4cac6c496 1G
Sep 16 16:32:50 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:50 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-39832049-a7db-4f82-937e-87ecd746d3c7 tempest-SnapshotDependencyTests-1109607946 None] Lock "cinder-quobyte-128be1ab-7049-440e-a60f-66a5a9e6ce29" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:50 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-39832049-a7db-4f82-937e-87ecd746d3c7 tempest-SnapshotDependencyTests-1109607946 None] Deleting offline snapshot 128be1ab-7049-440e-a60f-66a5a9e6ce29 of volume 3807066a-3adc-4890-9004-cec255d00d93 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:32:50 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-39832049-a7db-4f82-937e-87ecd746d3c7 tempest-SnapshotDependencyTests-1109607946 None] snapshot_file for this snap is: volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:32:50 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7959be7-8963-47d3-812d-35ef44214054]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-39832049-a7db-4f82-937e-87ecd746d3c7 tempest-SnapshotDependencyTests-1109607946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:50 devstack sudo[106907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29
Sep 16 16:32:50 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:50 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42ff47cf-27bb-49b9-a383-aa63f04af7de tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.1437ee6f-ff9f-4384-9e6d-d5c4cac6c496 1G" returned: 0 in 0.409s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42ff47cf-27bb-49b9-a383-aa63f04af7de tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e75b8fa-8c76-475f-ae32-427907ef776f -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.1437ee6f-ff9f-4384-9e6d-d5c4cac6c496 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:50 devstack sudo[106915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e75b8fa-8c76-475f-ae32-427907ef776f -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.1437ee6f-ff9f-4384-9e6d-d5c4cac6c496
Sep 16 16:32:50 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:50 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-39832049-a7db-4f82-937e-87ecd746d3c7 tempest-SnapshotDependencyTests-1109607946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29" returned: 0 in 0.388s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:50 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-39832049-a7db-4f82-937e-87ecd746d3c7 tempest-SnapshotDependencyTests-1109607946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3807066a-3adc-4890-9004-cec255d00d93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:32:50 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a790db49-55c5-494d-b67c-bebe463c5ac7]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-39832049-a7db-4f82-937e-87ecd746d3c7 tempest-SnapshotDependencyTests-1109607946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:50 devstack sudo[106917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93
Sep 16 16:32:50 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:50 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42ff47cf-27bb-49b9-a383-aa63f04af7de tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e75b8fa-8c76-475f-ae32-427907ef776f -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.1437ee6f-ff9f-4384-9e6d-d5c4cac6c496" returned: 0 in 0.334s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:50 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-42ff47cf-27bb-49b9-a383-aa63f04af7de tempest-ProjectReaderTests-1980496335 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.1437ee6f-ff9f-4384-9e6d-d5c4cac6c496 is being set with open permissions: ugo+rw
Sep 16 16:32:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42ff47cf-27bb-49b9-a383-aa63f04af7de tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.1437ee6f-ff9f-4384-9e6d-d5c4cac6c496 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:50 devstack sudo[106922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.1437ee6f-ff9f-4384-9e6d-d5c4cac6c496
Sep 16 16:32:50 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:50 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e42b8d97-4039-44d6-b204-0dfdbaf10f19 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:51 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42ff47cf-27bb-49b9-a383-aa63f04af7de tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.1437ee6f-ff9f-4384-9e6d-d5c4cac6c496" returned: 0 in 0.253s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42ff47cf-27bb-49b9-a383-aa63f04af7de tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:51 devstack sudo[106928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.info
Sep 16 16:32:51 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:51 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-39832049-a7db-4f82-937e-87ecd746d3c7 tempest-SnapshotDependencyTests-1109607946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93" returned: 0 in 0.589s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-39832049-a7db-4f82-937e-87ecd746d3c7 tempest-SnapshotDependencyTests-1109607946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:51 devstack sudo[106931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29
Sep 16 16:32:51 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:51 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42ff47cf-27bb-49b9-a383-aa63f04af7de tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.info" returned: 0 in 0.255s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:51 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-42ff47cf-27bb-49b9-a383-aa63f04af7de tempest-ProjectReaderTests-1980496335 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.info is being set with open permissions: ugo+rw
Sep 16 16:32:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42ff47cf-27bb-49b9-a383-aa63f04af7de tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:51 devstack sudo[106934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.info
Sep 16 16:32:51 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:51 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-39832049-a7db-4f82-937e-87ecd746d3c7 tempest-SnapshotDependencyTests-1109607946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29" returned: 0 in 0.339s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-39832049-a7db-4f82-937e-87ecd746d3c7 tempest-SnapshotDependencyTests-1109607946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:51 devstack sudo[106939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29
Sep 16 16:32:51 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:51 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-42ff47cf-27bb-49b9-a383-aa63f04af7de tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.info" returned: 0 in 0.257s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-42ff47cf-27bb-49b9-a383-aa63f04af7de tempest-ProjectReaderTests-1980496335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.018s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e42b8d97-4039-44d6-b204-0dfdbaf10f19 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.793s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:51 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-e42b8d97-4039-44d6-b204-0dfdbaf10f19 tempest-ProjectMemberTests-864664885 None] Creating offline snapshot d4a64cf2-987f-4ecb-b4ca-c8620fb57b00 of volume 0c1bc999-960e-4331-b091-bf6a8296f788 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:32:51 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-42ff47cf-27bb-49b9-a383-aa63f04af7de tempest-ProjectReaderTests-1980496335 None] Create snapshot completed successfully
Sep 16 16:32:51 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfc4f8f-71d2-4d07-a989-ff19180ab809]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e42b8d97-4039-44d6-b204-0dfdbaf10f19 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:51 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:51 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-39832049-a7db-4f82-937e-87ecd746d3c7 tempest-SnapshotDependencyTests-1109607946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93.128be1ab-7049-440e-a60f-66a5a9e6ce29" returned: 0 in 0.276s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:51 devstack sudo[106942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788
Sep 16 16:32:51 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:51 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-39832049-a7db-4f82-937e-87ecd746d3c7 tempest-SnapshotDependencyTests-1109607946 None] Lock "cinder-quobyte-128be1ab-7049-440e-a60f-66a5a9e6ce29" released by "_delete_snapshot" :: held 1.741s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:51 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-39832049-a7db-4f82-937e-87ecd746d3c7 tempest-SnapshotDependencyTests-1109607946 None] Lock "cinder-quobyte-3807066a-3adc-4890-9004-cec255d00d93" released by "delete_snapshot" :: held 1.768s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:51 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-39832049-a7db-4f82-937e-87ecd746d3c7 tempest-SnapshotDependencyTests-1109607946 None] Created reservations ['43e2520a-41cc-4017-bfed-a3cf77d3d303', 'a7f07626-d5e7-43ec-9e56-95a26f3cbe4f', '80a51bf7-c924-4f34-87f8-c83e186261e1', 'c8ca5f62-d36f-4243-ab6e-4942888d81f7'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:51 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-39832049-a7db-4f82-937e-87ecd746d3c7 tempest-SnapshotDependencyTests-1109607946 None] Delete snapshot completed successfully.
Sep 16 16:32:51 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-39832049-a7db-4f82-937e-87ecd746d3c7 tempest-SnapshotDependencyTests-1109607946 None] Lock "cinder-128be1ab-7049-440e-a60f-66a5a9e6ce29-delete_snapshot" released by "delete_snapshot" :: held 1.919s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:52 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e42b8d97-4039-44d6-b204-0dfdbaf10f19 tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788" returned: 0 in 0.385s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e42b8d97-4039-44d6-b204-0dfdbaf10f19 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.d4a64cf2-987f-4ecb-b4ca-c8620fb57b00 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:52 devstack sudo[106948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.d4a64cf2-987f-4ecb-b4ca-c8620fb57b00 1G
Sep 16 16:32:52 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-934aa4dd-6b56-4168-aa06-91a1c1564dd8 tempest-SnapshotDependencyTests-1109607946 None] Acquiring lock "cinder-3807066a-3adc-4890-9004-cec255d00d93-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-934aa4dd-6b56-4168-aa06-91a1c1564dd8 tempest-SnapshotDependencyTests-1109607946 None] Lock "cinder-3807066a-3adc-4890-9004-cec255d00d93-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-934aa4dd-6b56-4168-aa06-91a1c1564dd8 tempest-SnapshotDependencyTests-1109607946 None] Acquiring lock "cinder-quobyte-3807066a-3adc-4890-9004-cec255d00d93" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-934aa4dd-6b56-4168-aa06-91a1c1564dd8 tempest-SnapshotDependencyTests-1109607946 None] Lock "cinder-quobyte-3807066a-3adc-4890-9004-cec255d00d93" acquired by "delete_volume" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bc29f2-208a-4f4e-9966-5c627af6ad82]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-934aa4dd-6b56-4168-aa06-91a1c1564dd8 tempest-SnapshotDependencyTests-1109607946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:52 devstack sudo[106952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93
Sep 16 16:32:52 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:52 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e42b8d97-4039-44d6-b204-0dfdbaf10f19 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.d4a64cf2-987f-4ecb-b4ca-c8620fb57b00 1G" returned: 0 in 0.458s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e42b8d97-4039-44d6-b204-0dfdbaf10f19 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c1bc999-960e-4331-b091-bf6a8296f788 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.d4a64cf2-987f-4ecb-b4ca-c8620fb57b00 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:52 devstack sudo[106956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c1bc999-960e-4331-b091-bf6a8296f788 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.d4a64cf2-987f-4ecb-b4ca-c8620fb57b00
Sep 16 16:32:52 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:52 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-934aa4dd-6b56-4168-aa06-91a1c1564dd8 tempest-SnapshotDependencyTests-1109607946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93" returned: 0 in 0.407s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-934aa4dd-6b56-4168-aa06-91a1c1564dd8 tempest-SnapshotDependencyTests-1109607946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:52 devstack sudo[106961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93
Sep 16 16:32:52 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-557d15fc-8a8c-4ee2-878a-399281a363c5 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-1437ee6f-ff9f-4384-9e6d-d5c4cac6c496-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-557d15fc-8a8c-4ee2-878a-399281a363c5 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-1437ee6f-ff9f-4384-9e6d-d5c4cac6c496-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:52 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-557d15fc-8a8c-4ee2-878a-399281a363c5 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-quobyte-1e75b8fa-8c76-475f-ae32-427907ef776f" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e42b8d97-4039-44d6-b204-0dfdbaf10f19 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c1bc999-960e-4331-b091-bf6a8296f788 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.d4a64cf2-987f-4ecb-b4ca-c8620fb57b00" returned: 0 in 0.384s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:52 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-e42b8d97-4039-44d6-b204-0dfdbaf10f19 tempest-ProjectMemberTests-864664885 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.d4a64cf2-987f-4ecb-b4ca-c8620fb57b00 is being set with open permissions: ugo+rw
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e42b8d97-4039-44d6-b204-0dfdbaf10f19 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.d4a64cf2-987f-4ecb-b4ca-c8620fb57b00 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-557d15fc-8a8c-4ee2-878a-399281a363c5 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-1e75b8fa-8c76-475f-ae32-427907ef776f" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-557d15fc-8a8c-4ee2-878a-399281a363c5 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-quobyte-1437ee6f-ff9f-4384-9e6d-d5c4cac6c496" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:52 devstack sudo[106968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.d4a64cf2-987f-4ecb-b4ca-c8620fb57b00
Sep 16 16:32:52 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-557d15fc-8a8c-4ee2-878a-399281a363c5 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-1437ee6f-ff9f-4384-9e6d-d5c4cac6c496" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-557d15fc-8a8c-4ee2-878a-399281a363c5 tempest-ProjectReaderTests-1980496335 None] Deleting offline snapshot 1437ee6f-ff9f-4384-9e6d-d5c4cac6c496 of volume 1e75b8fa-8c76-475f-ae32-427907ef776f {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-557d15fc-8a8c-4ee2-878a-399281a363c5 tempest-ProjectReaderTests-1980496335 None] snapshot_file for this snap is: volume-1e75b8fa-8c76-475f-ae32-427907ef776f.1437ee6f-ff9f-4384-9e6d-d5c4cac6c496 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9370a5ec-b322-4135-8495-5d1d430d7bf7]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:52 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-557d15fc-8a8c-4ee2-878a-399281a363c5 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.1437ee6f-ff9f-4384-9e6d-d5c4cac6c496 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:53 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-934aa4dd-6b56-4168-aa06-91a1c1564dd8 tempest-SnapshotDependencyTests-1109607946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-3807066a-3adc-4890-9004-cec255d00d93" returned: 0 in 0.320s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-934aa4dd-6b56-4168-aa06-91a1c1564dd8 tempest-SnapshotDependencyTests-1109607946 None] Lock "cinder-quobyte-3807066a-3adc-4890-9004-cec255d00d93" released by "delete_volume" :: held 0.800s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-934aa4dd-6b56-4168-aa06-91a1c1564dd8 tempest-SnapshotDependencyTests-1109607946 None] Created reservations ['75ae686f-614d-457c-8f41-8de460cefda1', 'c3bce6c1-0254-4dd9-9396-4cc9f51f06bd', 'ce29a296-e962-4ff4-a01e-9645111296ad', '111df1cf-6a1c-4972-9b07-9bff58bdc50b'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:53 devstack sudo[106971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.1437ee6f-ff9f-4384-9e6d-d5c4cac6c496
Sep 16 16:32:53 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-934aa4dd-6b56-4168-aa06-91a1c1564dd8 tempest-SnapshotDependencyTests-1109607946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-934aa4dd-6b56-4168-aa06-91a1c1564dd8 tempest-SnapshotDependencyTests-1109607946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-934aa4dd-6b56-4168-aa06-91a1c1564dd8 tempest-SnapshotDependencyTests-1109607946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-934aa4dd-6b56-4168-aa06-91a1c1564dd8 tempest-SnapshotDependencyTests-1109607946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-934aa4dd-6b56-4168-aa06-91a1c1564dd8 tempest-SnapshotDependencyTests-1109607946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-934aa4dd-6b56-4168-aa06-91a1c1564dd8 tempest-SnapshotDependencyTests-1109607946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:53 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e42b8d97-4039-44d6-b204-0dfdbaf10f19 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.d4a64cf2-987f-4ecb-b4ca-c8620fb57b00" returned: 0 in 0.306s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:53 devstack sudo[106974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:32:53 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e42b8d97-4039-44d6-b204-0dfdbaf10f19 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:53 devstack sudo[106976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.info
Sep 16 16:32:53 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e863d2ab-0560-457b-90ee-d5f600e06a3f tempest-SnapshotDependencyTests-1109607946 None] Acquiring lock "cinder-50af31a9-9117-4a00-84db-25d8fb7de7e7-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e863d2ab-0560-457b-90ee-d5f600e06a3f tempest-SnapshotDependencyTests-1109607946 None] Lock "cinder-50af31a9-9117-4a00-84db-25d8fb7de7e7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:53 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-557d15fc-8a8c-4ee2-878a-399281a363c5 tempest-ProjectReaderTests-1980496335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.1437ee6f-ff9f-4384-9e6d-d5c4cac6c496" returned: 0 in 0.462s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-557d15fc-8a8c-4ee2-878a-399281a363c5 tempest-ProjectReaderTests-1980496335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e75b8fa-8c76-475f-ae32-427907ef776f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:32:53 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e863d2ab-0560-457b-90ee-d5f600e06a3f tempest-SnapshotDependencyTests-1109607946 None] Acquiring lock "cinder-quobyte-50af31a9-9117-4a00-84db-25d8fb7de7e7" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cb27da-4528-451b-ba41-aa8b069becc0]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-557d15fc-8a8c-4ee2-878a-399281a363c5 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-934aa4dd-6b56-4168-aa06-91a1c1564dd8 tempest-SnapshotDependencyTests-1109607946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.328s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-934aa4dd-6b56-4168-aa06-91a1c1564dd8 tempest-SnapshotDependencyTests-1109607946 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:32:53 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-934aa4dd-6b56-4168-aa06-91a1c1564dd8 tempest-SnapshotDependencyTests-1109607946 None] Deleted volume successfully.
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e863d2ab-0560-457b-90ee-d5f600e06a3f tempest-SnapshotDependencyTests-1109607946 None] Lock "cinder-quobyte-50af31a9-9117-4a00-84db-25d8fb7de7e7" acquired by "delete_volume" :: waited 0.039s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-934aa4dd-6b56-4168-aa06-91a1c1564dd8 tempest-SnapshotDependencyTests-1109607946 None] Lock "cinder-3807066a-3adc-4890-9004-cec255d00d93-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5229930-ddc8-47e4-b0ca-86446bb836f5]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e863d2ab-0560-457b-90ee-d5f600e06a3f tempest-SnapshotDependencyTests-1109607946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-50af31a9-9117-4a00-84db-25d8fb7de7e7 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:53 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e42b8d97-4039-44d6-b204-0dfdbaf10f19 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.info" returned: 0 in 0.357s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:53 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-e42b8d97-4039-44d6-b204-0dfdbaf10f19 tempest-ProjectMemberTests-864664885 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.info is being set with open permissions: ugo+rw
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e42b8d97-4039-44d6-b204-0dfdbaf10f19 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:53 devstack sudo[106986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.info
Sep 16 16:32:53 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:53 devstack sudo[106983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f
Sep 16 16:32:53 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:53 devstack sudo[106985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-50af31a9-9117-4a00-84db-25d8fb7de7e7
Sep 16 16:32:53 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:53 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e42b8d97-4039-44d6-b204-0dfdbaf10f19 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.info" returned: 0 in 0.259s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e42b8d97-4039-44d6-b204-0dfdbaf10f19 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.253s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:53 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-e42b8d97-4039-44d6-b204-0dfdbaf10f19 tempest-ProjectMemberTests-864664885 None] Create snapshot completed successfully
Sep 16 16:32:53 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-557d15fc-8a8c-4ee2-878a-399281a363c5 tempest-ProjectReaderTests-1980496335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f" returned: 0 in 0.429s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:53 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-557d15fc-8a8c-4ee2-878a-399281a363c5 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.1437ee6f-ff9f-4384-9e6d-d5c4cac6c496 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:53 devstack sudo[106996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.1437ee6f-ff9f-4384-9e6d-d5c4cac6c496
Sep 16 16:32:53 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:54 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e863d2ab-0560-457b-90ee-d5f600e06a3f tempest-SnapshotDependencyTests-1109607946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-50af31a9-9117-4a00-84db-25d8fb7de7e7" returned: 0 in 0.425s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e863d2ab-0560-457b-90ee-d5f600e06a3f tempest-SnapshotDependencyTests-1109607946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-50af31a9-9117-4a00-84db-25d8fb7de7e7 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:54 devstack sudo[106999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-50af31a9-9117-4a00-84db-25d8fb7de7e7
Sep 16 16:32:54 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:54 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e863d2ab-0560-457b-90ee-d5f600e06a3f tempest-SnapshotDependencyTests-1109607946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-50af31a9-9117-4a00-84db-25d8fb7de7e7" returned: 0 in 0.265s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:54 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-557d15fc-8a8c-4ee2-878a-399281a363c5 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.1437ee6f-ff9f-4384-9e6d-d5c4cac6c496" returned: 0 in 0.346s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-557d15fc-8a8c-4ee2-878a-399281a363c5 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.1437ee6f-ff9f-4384-9e6d-d5c4cac6c496 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e863d2ab-0560-457b-90ee-d5f600e06a3f tempest-SnapshotDependencyTests-1109607946 None] Lock "cinder-quobyte-50af31a9-9117-4a00-84db-25d8fb7de7e7" released by "delete_volume" :: held 0.754s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:54 devstack sudo[107005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.1437ee6f-ff9f-4384-9e6d-d5c4cac6c496
Sep 16 16:32:54 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:54 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-e863d2ab-0560-457b-90ee-d5f600e06a3f tempest-SnapshotDependencyTests-1109607946 None] Created reservations ['d6e1571a-9455-49c4-a594-85d50cdc249d', '3af6313d-9520-4691-b878-80d19b33d28f', '3d5c923a-23ed-4bdf-9b0d-4ed61f9939fc', '5fbfd8fe-ed19-4c09-bbb5-78fb1240cc95'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e863d2ab-0560-457b-90ee-d5f600e06a3f tempest-SnapshotDependencyTests-1109607946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e863d2ab-0560-457b-90ee-d5f600e06a3f tempest-SnapshotDependencyTests-1109607946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e863d2ab-0560-457b-90ee-d5f600e06a3f tempest-SnapshotDependencyTests-1109607946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:54 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e863d2ab-0560-457b-90ee-d5f600e06a3f tempest-SnapshotDependencyTests-1109607946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e863d2ab-0560-457b-90ee-d5f600e06a3f tempest-SnapshotDependencyTests-1109607946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e863d2ab-0560-457b-90ee-d5f600e06a3f tempest-SnapshotDependencyTests-1109607946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:54 devstack sudo[107007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:32:54 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:54 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-557d15fc-8a8c-4ee2-878a-399281a363c5 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f.1437ee6f-ff9f-4384-9e6d-d5c4cac6c496" returned: 0 in 0.276s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-557d15fc-8a8c-4ee2-878a-399281a363c5 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-1437ee6f-ff9f-4384-9e6d-d5c4cac6c496" released by "_delete_snapshot" :: held 1.657s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-557d15fc-8a8c-4ee2-878a-399281a363c5 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-1e75b8fa-8c76-475f-ae32-427907ef776f" released by "delete_snapshot" :: held 1.686s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:54 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-557d15fc-8a8c-4ee2-878a-399281a363c5 tempest-ProjectReaderTests-1980496335 None] Created reservations ['38e80ce8-bffb-4f11-9a52-82e66611360e', '42f586ae-521c-4602-97e5-72f0762ee0aa', 'f57cd54f-3ec8-438a-b536-2bac270ca5ff', 'e35ff632-534e-49a9-8dab-ec89d0da2963'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:54 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:54 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e863d2ab-0560-457b-90ee-d5f600e06a3f tempest-SnapshotDependencyTests-1109607946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.295s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:54 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-e863d2ab-0560-457b-90ee-d5f600e06a3f tempest-SnapshotDependencyTests-1109607946 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:32:54 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-e863d2ab-0560-457b-90ee-d5f600e06a3f tempest-SnapshotDependencyTests-1109607946 None] Deleted volume successfully.
Sep 16 16:32:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e863d2ab-0560-457b-90ee-d5f600e06a3f tempest-SnapshotDependencyTests-1109607946 None] Lock "cinder-50af31a9-9117-4a00-84db-25d8fb7de7e7-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:54 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-557d15fc-8a8c-4ee2-878a-399281a363c5 tempest-ProjectReaderTests-1980496335 None] Delete snapshot completed successfully.
Sep 16 16:32:54 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-557d15fc-8a8c-4ee2-878a-399281a363c5 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-1437ee6f-ff9f-4384-9e6d-d5c4cac6c496-delete_snapshot" released by "delete_snapshot" :: held 1.883s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7e9d337f-8c3e-4856-b5bf-e914264c2a5f tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-1e75b8fa-8c76-475f-ae32-427907ef776f-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7e9d337f-8c3e-4856-b5bf-e914264c2a5f tempest-ProjectReaderTests-1980496335 None] Lock "cinder-1e75b8fa-8c76-475f-ae32-427907ef776f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-17faf71f-34ad-4b8e-b5f8-807957e62871 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-d4a64cf2-987f-4ecb-b4ca-c8620fb57b00-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-17faf71f-34ad-4b8e-b5f8-807957e62871 tempest-ProjectMemberTests-864664885 None] Lock "cinder-d4a64cf2-987f-4ecb-b4ca-c8620fb57b00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-17faf71f-34ad-4b8e-b5f8-807957e62871 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-0c1bc999-960e-4331-b091-bf6a8296f788" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7e9d337f-8c3e-4856-b5bf-e914264c2a5f tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-quobyte-1e75b8fa-8c76-475f-ae32-427907ef776f" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-17faf71f-34ad-4b8e-b5f8-807957e62871 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-0c1bc999-960e-4331-b091-bf6a8296f788" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-17faf71f-34ad-4b8e-b5f8-807957e62871 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-d4a64cf2-987f-4ecb-b4ca-c8620fb57b00" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7e9d337f-8c3e-4856-b5bf-e914264c2a5f tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-1e75b8fa-8c76-475f-ae32-427907ef776f" acquired by "delete_volume" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-17faf71f-34ad-4b8e-b5f8-807957e62871 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-d4a64cf2-987f-4ecb-b4ca-c8620fb57b00" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-17faf71f-34ad-4b8e-b5f8-807957e62871 tempest-ProjectMemberTests-864664885 None] Deleting offline snapshot d4a64cf2-987f-4ecb-b4ca-c8620fb57b00 of volume 0c1bc999-960e-4331-b091-bf6a8296f788 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-17faf71f-34ad-4b8e-b5f8-807957e62871 tempest-ProjectMemberTests-864664885 None] snapshot_file for this snap is: volume-0c1bc999-960e-4331-b091-bf6a8296f788.d4a64cf2-987f-4ecb-b4ca-c8620fb57b00 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8abda0a-5981-4dee-8660-5466a73640a4]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e9d337f-8c3e-4856-b5bf-e914264c2a5f tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb8b706-c72a-475c-a149-f289d4f876d2]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-17faf71f-34ad-4b8e-b5f8-807957e62871 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.d4a64cf2-987f-4ecb-b4ca-c8620fb57b00 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:55 devstack sudo[107012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.d4a64cf2-987f-4ecb-b4ca-c8620fb57b00
Sep 16 16:32:55 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:55 devstack sudo[107011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f
Sep 16 16:32:55 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:55 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e9d337f-8c3e-4856-b5bf-e914264c2a5f tempest-ProjectReaderTests-1980496335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f" returned: 0 in 0.433s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e9d337f-8c3e-4856-b5bf-e914264c2a5f tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:55 devstack sudo[107022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f
Sep 16 16:32:55 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:55 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-17faf71f-34ad-4b8e-b5f8-807957e62871 tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.d4a64cf2-987f-4ecb-b4ca-c8620fb57b00" returned: 0 in 0.455s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-17faf71f-34ad-4b8e-b5f8-807957e62871 tempest-ProjectMemberTests-864664885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c1bc999-960e-4331-b091-bf6a8296f788(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdaa0c0-67f5-4f39-83aa-c44e8025ac9f]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-17faf71f-34ad-4b8e-b5f8-807957e62871 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:55 devstack sudo[107024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788
Sep 16 16:32:55 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:55 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:55 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e9d337f-8c3e-4856-b5bf-e914264c2a5f tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-1e75b8fa-8c76-475f-ae32-427907ef776f" returned: 0 in 0.312s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7e9d337f-8c3e-4856-b5bf-e914264c2a5f tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-1e75b8fa-8c76-475f-ae32-427907ef776f" released by "delete_volume" :: held 0.846s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-7e9d337f-8c3e-4856-b5bf-e914264c2a5f tempest-ProjectReaderTests-1980496335 None] Created reservations ['c46073e3-6175-4f4b-bf01-03ea61d1125b', '3405369f-1513-47bb-a397-92d0e725bcd9', 'f09fc5a4-b85c-49b0-873e-0ddf3e816a1d', 'c43d1cb1-4186-433b-8a67-d382162cae04'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7e9d337f-8c3e-4856-b5bf-e914264c2a5f tempest-ProjectReaderTests-1980496335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7e9d337f-8c3e-4856-b5bf-e914264c2a5f tempest-ProjectReaderTests-1980496335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7e9d337f-8c3e-4856-b5bf-e914264c2a5f tempest-ProjectReaderTests-1980496335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7e9d337f-8c3e-4856-b5bf-e914264c2a5f tempest-ProjectReaderTests-1980496335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7e9d337f-8c3e-4856-b5bf-e914264c2a5f tempest-ProjectReaderTests-1980496335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e9d337f-8c3e-4856-b5bf-e914264c2a5f tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:56 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-17faf71f-34ad-4b8e-b5f8-807957e62871 tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788" returned: 0 in 0.465s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-17faf71f-34ad-4b8e-b5f8-807957e62871 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.d4a64cf2-987f-4ecb-b4ca-c8620fb57b00 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:56 devstack sudo[107031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:32:56 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:56 devstack sudo[107032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.d4a64cf2-987f-4ecb-b4ca-c8620fb57b00
Sep 16 16:32:56 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:56 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7e9d337f-8c3e-4856-b5bf-e914264c2a5f tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.322s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-7e9d337f-8c3e-4856-b5bf-e914264c2a5f tempest-ProjectReaderTests-1980496335 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:32:56 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-7e9d337f-8c3e-4856-b5bf-e914264c2a5f tempest-ProjectReaderTests-1980496335 None] Deleted volume successfully.
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7e9d337f-8c3e-4856-b5bf-e914264c2a5f tempest-ProjectReaderTests-1980496335 None] Lock "cinder-1e75b8fa-8c76-475f-ae32-427907ef776f-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:56 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-17faf71f-34ad-4b8e-b5f8-807957e62871 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.d4a64cf2-987f-4ecb-b4ca-c8620fb57b00" returned: 0 in 0.495s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-17faf71f-34ad-4b8e-b5f8-807957e62871 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.d4a64cf2-987f-4ecb-b4ca-c8620fb57b00 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:56 devstack sudo[107041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.d4a64cf2-987f-4ecb-b4ca-c8620fb57b00
Sep 16 16:32:56 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Flow 'volume_create_manager' (84fd1a59-2654-4b0d-9ad7-0646acd67fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e273fe42-1cb6-4c39-a337-99c1cd7f9d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e273fe42-1cb6-4c39-a337-99c1cd7f9d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511851058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6db155-0601-494f-acac-0fec7ddb5404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f21e422bf24b959140b013ddc9f55c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:57Z,use_quota=True,user_id='5e74c6be511f44b59a2cf5e55f725d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174cf90a-6536-433f-95ac-be84f7090db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174cf90a-6536-433f-95ac-be84f7090db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6db00f-4d6c-4176-ad63-9bb7b8db84e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6db00f-4d6c-4176-ad63-9bb7b8db84e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f6db155-0601-494f-acac-0fec7ddb5404', 'volume_name': 'volume-6f6db155-0601-494f-acac-0fec7ddb5404', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af3ea35-4cac-40aa-8b8c-3deca9e2b402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af3ea35-4cac-40aa-8b8c-3deca9e2b402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c7a15f-a60a-4b26-89b7-247c07016475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:56 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Volume 6f6db155-0601-494f-acac-0fec7ddb5404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f6db155-0601-494f-acac-0fec7ddb5404', 'volume_size': 1}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511851058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6db155-0601-494f-acac-0fec7ddb5404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f21e422bf24b959140b013ddc9f55c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:57Z,use_quota=True,user_id='5e74c6be511f44b59a2cf5e55f725d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Creating volume 6f6db155-0601-494f-acac-0fec7ddb5404 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:56 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:56 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:32:57 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-17faf71f-34ad-4b8e-b5f8-807957e62871 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788.d4a64cf2-987f-4ecb-b4ca-c8620fb57b00" returned: 0 in 0.303s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:57 devstack sudo[107044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404 1073741824
Sep 16 16:32:57 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-17faf71f-34ad-4b8e-b5f8-807957e62871 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-d4a64cf2-987f-4ecb-b4ca-c8620fb57b00" released by "_delete_snapshot" :: held 1.839s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-17faf71f-34ad-4b8e-b5f8-807957e62871 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-0c1bc999-960e-4331-b091-bf6a8296f788" released by "delete_snapshot" :: held 1.909s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-17faf71f-34ad-4b8e-b5f8-807957e62871 tempest-ProjectMemberTests-864664885 None] Created reservations ['9b493cbe-e107-4109-9d28-22ae97da428a', 'f1f2e9b7-e14d-4851-8af0-be03a950949f', 'be332abe-d8fa-4912-9afd-db47390aa58d', 'd34f361b-d9e4-4597-879d-44c07b62f6d1'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:57 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-17faf71f-34ad-4b8e-b5f8-807957e62871 tempest-ProjectMemberTests-864664885 None] Delete snapshot completed successfully.
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-17faf71f-34ad-4b8e-b5f8-807957e62871 tempest-ProjectMemberTests-864664885 None] Lock "cinder-d4a64cf2-987f-4ecb-b4ca-c8620fb57b00-delete_snapshot" released by "delete_snapshot" :: held 2.101s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-912de2d1-e44f-46f5-8c97-2918ae49e16b tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-0c1bc999-960e-4331-b091-bf6a8296f788-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-912de2d1-e44f-46f5-8c97-2918ae49e16b tempest-ProjectMemberTests-864664885 None] Lock "cinder-0c1bc999-960e-4331-b091-bf6a8296f788-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-912de2d1-e44f-46f5-8c97-2918ae49e16b tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-0c1bc999-960e-4331-b091-bf6a8296f788" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-912de2d1-e44f-46f5-8c97-2918ae49e16b tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-0c1bc999-960e-4331-b091-bf6a8296f788" acquired by "delete_volume" :: waited 0.018s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f034d8-4269-4e35-90ab-623b629b362b]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-912de2d1-e44f-46f5-8c97-2918ae49e16b tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:57 devstack sudo[107050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788
Sep 16 16:32:57 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:57 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404 1073741824" returned: 0 in 0.554s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:57 devstack sudo[107052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404
Sep 16 16:32:57 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:57 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-912de2d1-e44f-46f5-8c97-2918ae49e16b tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788" returned: 0 in 0.476s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-912de2d1-e44f-46f5-8c97-2918ae49e16b tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:57 devstack sudo[107059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788
Sep 16 16:32:57 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:57 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404" returned: 0 in 0.370s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c7a15f-a60a-4b26-89b7-247c07016475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f6db155-0601-494f-acac-0fec7ddb5404', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:57 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5b0c6f-ad86-457d-8b04-a0748a5ed140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:57 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Volume volume-6f6db155-0601-494f-acac-0fec7ddb5404 (6f6db155-0601-494f-acac-0fec7ddb5404): created successfully
Sep 16 16:32:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5b0c6f-ad86-457d-8b04-a0748a5ed140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:58 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Flow 'volume_create_manager' (84fd1a59-2654-4b0d-9ad7-0646acd67fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:58 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b0da5ea6-e7b7-4e5a-89c6-d6b2a4d94bfe tempest-ProjectReaderTests-1980496335 None] Created volume successfully.
Sep 16 16:32:58 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-912de2d1-e44f-46f5-8c97-2918ae49e16b tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-0c1bc999-960e-4331-b091-bf6a8296f788" returned: 0 in 0.300s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:58 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-912de2d1-e44f-46f5-8c97-2918ae49e16b tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-0c1bc999-960e-4331-b091-bf6a8296f788" released by "delete_volume" :: held 0.845s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:58 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-912de2d1-e44f-46f5-8c97-2918ae49e16b tempest-ProjectMemberTests-864664885 None] Created reservations ['09df9e29-b9d1-4bad-8bab-09c9bd00e556', '5510cc08-54af-4539-919c-ddbf74454d60', 'c2b35194-535a-48d3-ae78-71ff12665194', 'efde5bbc-b41d-4bb0-b90d-f189dde85001'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:32:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-912de2d1-e44f-46f5-8c97-2918ae49e16b tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-912de2d1-e44f-46f5-8c97-2918ae49e16b tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:58 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-912de2d1-e44f-46f5-8c97-2918ae49e16b tempest-ProjectMemberTests-864664885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:58 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-912de2d1-e44f-46f5-8c97-2918ae49e16b tempest-ProjectMemberTests-864664885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-912de2d1-e44f-46f5-8c97-2918ae49e16b tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-912de2d1-e44f-46f5-8c97-2918ae49e16b tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:58 devstack sudo[107062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:32:58 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:58 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:58 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-912de2d1-e44f-46f5-8c97-2918ae49e16b tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.262s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:58 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-912de2d1-e44f-46f5-8c97-2918ae49e16b tempest-ProjectMemberTests-864664885 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:32:58 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-912de2d1-e44f-46f5-8c97-2918ae49e16b tempest-ProjectMemberTests-864664885 None] Deleted volume successfully.
Sep 16 16:32:58 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-912de2d1-e44f-46f5-8c97-2918ae49e16b tempest-ProjectMemberTests-864664885 None] Lock "cinder-0c1bc999-960e-4331-b091-bf6a8296f788-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Flow 'volume_create_manager' (29ad5dd3-28bf-4a5b-9b85-282574f0bc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f9439a-5892-4ff8-9212-7a551114f00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f9439a-5892-4ff8-9212-7a551114f00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1542341685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c7ab28-2168-441f-84a3-9dfdc81c05c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4be84013f847d4a2f15dde740a2536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:59Z,use_quota=True,user_id='ae825737116546298fd942e8502abe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ed216b-75ea-4aea-b0f1-14860872624e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ed216b-75ea-4aea-b0f1-14860872624e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9bb6e4-463b-4f7f-a8fa-94ae652cf7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9bb6e4-463b-4f7f-a8fa-94ae652cf7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53c7ab28-2168-441f-84a3-9dfdc81c05c8', 'volume_name': 'volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20921373-6134-43dd-b2d0-bc1a86fd4103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20921373-6134-43dd-b2d0-bc1a86fd4103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f17cf3d-bc22-4b53-b5bc-bc3abd1e1e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:32:59 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Volume 53c7ab28-2168-441f-84a3-9dfdc81c05c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8', 'volume_size': 1}
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1542341685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c7ab28-2168-441f-84a3-9dfdc81c05c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4be84013f847d4a2f15dde740a2536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:59Z,use_quota=True,user_id='ae825737116546298fd942e8502abe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Creating volume 53c7ab28-2168-441f-84a3-9dfdc81c05c8 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:32:59 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:59 devstack sudo[107065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8 1073741824
Sep 16 16:32:59 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a3a7c7a0-4d76-43d4-921d-06fa31e84b4d tempest-ProjectReaderTests-1980496335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:32:59 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8 1073741824" returned: 0 in 0.497s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:32:59 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:32:59 devstack sudo[107071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8
Sep 16 16:32:59 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:00 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8" returned: 0 in 0.341s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:33:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a3a7c7a0-4d76-43d4-921d-06fa31e84b4d tempest-ProjectReaderTests-1980496335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.785s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f17cf3d-bc22-4b53-b5bc-bc3abd1e1e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d18366-45a2-40e4-9567-03382fad5c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:00 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-a3a7c7a0-4d76-43d4-921d-06fa31e84b4d tempest-ProjectReaderTests-1980496335 None] Creating offline snapshot 47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1 of volume 6f6db155-0601-494f-acac-0fec7ddb5404 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:33:00 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Volume volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8 (53c7ab28-2168-441f-84a3-9dfdc81c05c8): created successfully
Sep 16 16:33:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d18366-45a2-40e4-9567-03382fad5c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:00 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Flow 'volume_create_manager' (29ad5dd3-28bf-4a5b-9b85-282574f0bc5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:33:00 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00b6864-f858-4cd4-9c81-51378a8d8406]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a3a7c7a0-4d76-43d4-921d-06fa31e84b4d tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:00 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-07d57145-4b7f-403d-8b87-3427cc49cdc4 tempest-ProjectMemberTests-864664885 None] Created volume successfully.
Sep 16 16:33:00 devstack sudo[107075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404
Sep 16 16:33:00 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:00 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a3a7c7a0-4d76-43d4-921d-06fa31e84b4d tempest-ProjectReaderTests-1980496335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404" returned: 0 in 0.397s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a3a7c7a0-4d76-43d4-921d-06fa31e84b4d tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:00 devstack sudo[107080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1 1G
Sep 16 16:33:00 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:00 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a3a7c7a0-4d76-43d4-921d-06fa31e84b4d tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1 1G" returned: 0 in 0.461s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:00 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a3a7c7a0-4d76-43d4-921d-06fa31e84b4d tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6db155-0601-494f-acac-0fec7ddb5404 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:00 devstack sudo[107086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6db155-0601-494f-acac-0fec7ddb5404 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1
Sep 16 16:33:00 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:01 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a3a7c7a0-4d76-43d4-921d-06fa31e84b4d tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6db155-0601-494f-acac-0fec7ddb5404 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1" returned: 0 in 0.367s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:01 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-a3a7c7a0-4d76-43d4-921d-06fa31e84b4d tempest-ProjectReaderTests-1980496335 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1 is being set with open permissions: ugo+rw
Sep 16 16:33:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a3a7c7a0-4d76-43d4-921d-06fa31e84b4d tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:01 devstack sudo[107092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1
Sep 16 16:33:01 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8f196166-52da-44bb-a26f-35eb15f39607 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:01 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a3a7c7a0-4d76-43d4-921d-06fa31e84b4d tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1" returned: 0 in 0.254s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a3a7c7a0-4d76-43d4-921d-06fa31e84b4d tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:01 devstack sudo[107097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.info
Sep 16 16:33:01 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:01 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a3a7c7a0-4d76-43d4-921d-06fa31e84b4d tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.info" returned: 0 in 0.329s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:01 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-a3a7c7a0-4d76-43d4-921d-06fa31e84b4d tempest-ProjectReaderTests-1980496335 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.info is being set with open permissions: ugo+rw
Sep 16 16:33:01 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a3a7c7a0-4d76-43d4-921d-06fa31e84b4d tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:01 devstack sudo[107100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.info
Sep 16 16:33:01 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:02 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a3a7c7a0-4d76-43d4-921d-06fa31e84b4d tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.info" returned: 0 in 0.270s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a3a7c7a0-4d76-43d4-921d-06fa31e84b4d tempest-ProjectReaderTests-1980496335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.212s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8f196166-52da-44bb-a26f-35eb15f39607 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.846s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-8f196166-52da-44bb-a26f-35eb15f39607 tempest-ProjectMemberTests-864664885 None] Creating offline snapshot bfa36ece-22e3-45b8-83aa-7d64cf01d7b1 of volume 53c7ab28-2168-441f-84a3-9dfdc81c05c8 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:33:02 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-a3a7c7a0-4d76-43d4-921d-06fa31e84b4d tempest-ProjectReaderTests-1980496335 None] Create snapshot completed successfully
Sep 16 16:33:02 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c008c0-bad8-4f80-87be-1c8aa2bc3cf4]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8f196166-52da-44bb-a26f-35eb15f39607 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ff320cac-b65b-49f2-beb3-b144675a1a95 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:02 devstack sudo[107103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8
Sep 16 16:33:02 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ff320cac-b65b-49f2-beb3-b144675a1a95 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ff320cac-b65b-49f2-beb3-b144675a1a95 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-quobyte-6f6db155-0601-494f-acac-0fec7ddb5404" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ff320cac-b65b-49f2-beb3-b144675a1a95 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-6f6db155-0601-494f-acac-0fec7ddb5404" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ff320cac-b65b-49f2-beb3-b144675a1a95 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-quobyte-47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:02 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ff320cac-b65b-49f2-beb3-b144675a1a95 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-ff320cac-b65b-49f2-beb3-b144675a1a95 tempest-ProjectReaderTests-1980496335 None] Deleting offline snapshot 47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1 of volume 6f6db155-0601-494f-acac-0fec7ddb5404 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:33:02 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-ff320cac-b65b-49f2-beb3-b144675a1a95 tempest-ProjectReaderTests-1980496335 None] snapshot_file for this snap is: volume-6f6db155-0601-494f-acac-0fec7ddb5404.47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:33:02 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f9549b-ed0b-40be-a394-59fabd663bee]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff320cac-b65b-49f2-beb3-b144675a1a95 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:02 devstack sudo[107105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1
Sep 16 16:33:02 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:02 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8f196166-52da-44bb-a26f-35eb15f39607 tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8" returned: 0 in 0.474s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:02 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8f196166-52da-44bb-a26f-35eb15f39607 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.bfa36ece-22e3-45b8-83aa-7d64cf01d7b1 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:02 devstack sudo[107110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.bfa36ece-22e3-45b8-83aa-7d64cf01d7b1 1G
Sep 16 16:33:02 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:03 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff320cac-b65b-49f2-beb3-b144675a1a95 tempest-ProjectReaderTests-1980496335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1" returned: 0 in 0.466s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:03 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-ff320cac-b65b-49f2-beb3-b144675a1a95 tempest-ProjectReaderTests-1980496335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f6db155-0601-494f-acac-0fec7ddb5404(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:33:03 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[310bdad5-603c-4594-bc1d-a6756f37f0a0]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff320cac-b65b-49f2-beb3-b144675a1a95 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:03 devstack sudo[107118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404
Sep 16 16:33:03 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:03 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8f196166-52da-44bb-a26f-35eb15f39607 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.bfa36ece-22e3-45b8-83aa-7d64cf01d7b1 1G" returned: 0 in 0.457s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8f196166-52da-44bb-a26f-35eb15f39607 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.bfa36ece-22e3-45b8-83aa-7d64cf01d7b1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:03 devstack sudo[107121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.bfa36ece-22e3-45b8-83aa-7d64cf01d7b1
Sep 16 16:33:03 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:03 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff320cac-b65b-49f2-beb3-b144675a1a95 tempest-ProjectReaderTests-1980496335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404" returned: 0 in 0.377s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff320cac-b65b-49f2-beb3-b144675a1a95 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:03 devstack sudo[107128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1
Sep 16 16:33:03 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:03 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8f196166-52da-44bb-a26f-35eb15f39607 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.bfa36ece-22e3-45b8-83aa-7d64cf01d7b1" returned: 0 in 0.309s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:03 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-8f196166-52da-44bb-a26f-35eb15f39607 tempest-ProjectMemberTests-864664885 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.bfa36ece-22e3-45b8-83aa-7d64cf01d7b1 is being set with open permissions: ugo+rw
Sep 16 16:33:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8f196166-52da-44bb-a26f-35eb15f39607 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.bfa36ece-22e3-45b8-83aa-7d64cf01d7b1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:03 devstack sudo[107132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.bfa36ece-22e3-45b8-83aa-7d64cf01d7b1
Sep 16 16:33:03 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:03 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff320cac-b65b-49f2-beb3-b144675a1a95 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1" returned: 0 in 0.428s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff320cac-b65b-49f2-beb3-b144675a1a95 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:03 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8f196166-52da-44bb-a26f-35eb15f39607 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.bfa36ece-22e3-45b8-83aa-7d64cf01d7b1" returned: 0 in 0.352s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:03 devstack sudo[107139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1
Sep 16 16:33:03 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:03 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8f196166-52da-44bb-a26f-35eb15f39607 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:04 devstack sudo[107141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.info
Sep 16 16:33:04 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:04 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-ff320cac-b65b-49f2-beb3-b144675a1a95 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404.47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1" returned: 0 in 0.281s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ff320cac-b65b-49f2-beb3-b144675a1a95 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1" released by "_delete_snapshot" :: held 1.680s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ff320cac-b65b-49f2-beb3-b144675a1a95 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-6f6db155-0601-494f-acac-0fec7ddb5404" released by "delete_snapshot" :: held 1.713s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:04 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8f196166-52da-44bb-a26f-35eb15f39607 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.info" returned: 0 in 0.286s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:04 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-8f196166-52da-44bb-a26f-35eb15f39607 tempest-ProjectMemberTests-864664885 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.info is being set with open permissions: ugo+rw
Sep 16 16:33:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8f196166-52da-44bb-a26f-35eb15f39607 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:04 devstack sudo[107145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.info
Sep 16 16:33:04 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:04 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-ff320cac-b65b-49f2-beb3-b144675a1a95 tempest-ProjectReaderTests-1980496335 None] Created reservations ['fee363bf-42ef-42e1-a6df-8eb915babdfe', '9baeaeb3-1045-4672-8e13-569fcde027f5', 'cc015697-ecce-4829-b8df-041ae65b0ad0', '0d2e2832-79ee-487d-9657-bede0ec9a668'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:33:04 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-ff320cac-b65b-49f2-beb3-b144675a1a95 tempest-ProjectReaderTests-1980496335 None] Delete snapshot completed successfully.
Sep 16 16:33:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-ff320cac-b65b-49f2-beb3-b144675a1a95 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-47bb5fbf-3375-4fb2-a8fc-f73cfb1d97e1-delete_snapshot" released by "delete_snapshot" :: held 1.896s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:04 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8f196166-52da-44bb-a26f-35eb15f39607 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.info" returned: 0 in 0.264s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8f196166-52da-44bb-a26f-35eb15f39607 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.298s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:04 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-8f196166-52da-44bb-a26f-35eb15f39607 tempest-ProjectMemberTests-864664885 None] Create snapshot completed successfully
Sep 16 16:33:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e4b39ec1-cc04-44ff-b7b0-c60fcde06843 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-6f6db155-0601-494f-acac-0fec7ddb5404-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e4b39ec1-cc04-44ff-b7b0-c60fcde06843 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-6f6db155-0601-494f-acac-0fec7ddb5404-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e4b39ec1-cc04-44ff-b7b0-c60fcde06843 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-quobyte-6f6db155-0601-494f-acac-0fec7ddb5404" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:04 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e4b39ec1-cc04-44ff-b7b0-c60fcde06843 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-6f6db155-0601-494f-acac-0fec7ddb5404" acquired by "delete_volume" :: waited 0.026s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:04 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9233af89-16c6-462c-8004-131311478180]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:04 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e4b39ec1-cc04-44ff-b7b0-c60fcde06843 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:04 devstack sudo[107149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404
Sep 16 16:33:04 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:05 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e4b39ec1-cc04-44ff-b7b0-c60fcde06843 tempest-ProjectReaderTests-1980496335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404" returned: 0 in 0.458s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e4b39ec1-cc04-44ff-b7b0-c60fcde06843 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:05 devstack sudo[107155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404
Sep 16 16:33:05 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:05 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e4b39ec1-cc04-44ff-b7b0-c60fcde06843 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-6f6db155-0601-494f-acac-0fec7ddb5404" returned: 0 in 0.319s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e4b39ec1-cc04-44ff-b7b0-c60fcde06843 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-6f6db155-0601-494f-acac-0fec7ddb5404" released by "delete_volume" :: held 0.865s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5257b6f9-2fd3-4c24-9631-601f64ee4f60 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-bfa36ece-22e3-45b8-83aa-7d64cf01d7b1-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=208,cinder:SELECT=175,cinder:DELETE=18,cinder:INSERT=54 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5257b6f9-2fd3-4c24-9631-601f64ee4f60 tempest-ProjectMemberTests-864664885 None] Lock "cinder-bfa36ece-22e3-45b8-83aa-7d64cf01d7b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5257b6f9-2fd3-4c24-9631-601f64ee4f60 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-53c7ab28-2168-441f-84a3-9dfdc81c05c8" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5257b6f9-2fd3-4c24-9631-601f64ee4f60 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-53c7ab28-2168-441f-84a3-9dfdc81c05c8" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5257b6f9-2fd3-4c24-9631-601f64ee4f60 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-bfa36ece-22e3-45b8-83aa-7d64cf01d7b1" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-e4b39ec1-cc04-44ff-b7b0-c60fcde06843 tempest-ProjectReaderTests-1980496335 None] Created reservations ['5ea8ac5f-3e03-408b-a5e4-23f1c90f8039', '1847c808-4947-4cdf-8b53-48bf0228dea1', '9406fbbd-09fb-4e38-bf2b-bdca62db1997', 'f78184e7-b205-4f5a-9c7d-4d00e46056b7'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=215,cinder:SELECT=150,cinder:INSERT=57,cinder:DELETE=19 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5257b6f9-2fd3-4c24-9631-601f64ee4f60 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-bfa36ece-22e3-45b8-83aa-7d64cf01d7b1" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-5257b6f9-2fd3-4c24-9631-601f64ee4f60 tempest-ProjectMemberTests-864664885 None] Deleting offline snapshot bfa36ece-22e3-45b8-83aa-7d64cf01d7b1 of volume 53c7ab28-2168-441f-84a3-9dfdc81c05c8 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-5257b6f9-2fd3-4c24-9631-601f64ee4f60 tempest-ProjectMemberTests-864664885 None] snapshot_file for this snap is: volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.bfa36ece-22e3-45b8-83aa-7d64cf01d7b1 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfb7400-cb66-4a87-b742-fc9236703e01]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5257b6f9-2fd3-4c24-9631-601f64ee4f60 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.bfa36ece-22e3-45b8-83aa-7d64cf01d7b1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e4b39ec1-cc04-44ff-b7b0-c60fcde06843 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e4b39ec1-cc04-44ff-b7b0-c60fcde06843 tempest-ProjectReaderTests-1980496335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e4b39ec1-cc04-44ff-b7b0-c60fcde06843 tempest-ProjectReaderTests-1980496335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e4b39ec1-cc04-44ff-b7b0-c60fcde06843 tempest-ProjectReaderTests-1980496335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e4b39ec1-cc04-44ff-b7b0-c60fcde06843 tempest-ProjectReaderTests-1980496335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:05 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e4b39ec1-cc04-44ff-b7b0-c60fcde06843 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:05 devstack sudo[107159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:33:05 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:05 devstack sudo[107158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.bfa36ece-22e3-45b8-83aa-7d64cf01d7b1
Sep 16 16:33:05 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:06 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e4b39ec1-cc04-44ff-b7b0-c60fcde06843 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.317s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:06 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-e4b39ec1-cc04-44ff-b7b0-c60fcde06843 tempest-ProjectReaderTests-1980496335 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:33:06 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-e4b39ec1-cc04-44ff-b7b0-c60fcde06843 tempest-ProjectReaderTests-1980496335 None] Deleted volume successfully.
Sep 16 16:33:06 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-e4b39ec1-cc04-44ff-b7b0-c60fcde06843 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-6f6db155-0601-494f-acac-0fec7ddb5404-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:06 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5257b6f9-2fd3-4c24-9631-601f64ee4f60 tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.bfa36ece-22e3-45b8-83aa-7d64cf01d7b1" returned: 0 in 0.481s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:06 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-5257b6f9-2fd3-4c24-9631-601f64ee4f60 tempest-ProjectMemberTests-864664885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:33:06 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[238bdf98-da96-4cec-a74a-6d7eacb1dcab]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5257b6f9-2fd3-4c24-9631-601f64ee4f60 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:06 devstack sudo[107166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8
Sep 16 16:33:06 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:06 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5257b6f9-2fd3-4c24-9631-601f64ee4f60 tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8" returned: 0 in 0.444s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:06 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5257b6f9-2fd3-4c24-9631-601f64ee4f60 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.bfa36ece-22e3-45b8-83aa-7d64cf01d7b1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:06 devstack sudo[107171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.bfa36ece-22e3-45b8-83aa-7d64cf01d7b1
Sep 16 16:33:06 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:33:07 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5257b6f9-2fd3-4c24-9631-601f64ee4f60 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.bfa36ece-22e3-45b8-83aa-7d64cf01d7b1" returned: 0 in 0.461s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5257b6f9-2fd3-4c24-9631-601f64ee4f60 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.bfa36ece-22e3-45b8-83aa-7d64cf01d7b1 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:07 devstack sudo[107177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:33:07 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:07 devstack sudo[107178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.bfa36ece-22e3-45b8-83aa-7d64cf01d7b1
Sep 16 16:33:07 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:07 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-5257b6f9-2fd3-4c24-9631-601f64ee4f60 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8.bfa36ece-22e3-45b8-83aa-7d64cf01d7b1" returned: 0 in 0.409s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:07 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Flow 'volume_create_manager' (2f6ee371-3b27-4fee-b03d-d1468f9da412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8529246d-a715-44ea-a0ce-d9742b8f7be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.498s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5257b6f9-2fd3-4c24-9631-601f64ee4f60 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-bfa36ece-22e3-45b8-83aa-7d64cf01d7b1" released by "_delete_snapshot" :: held 1.983s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8529246d-a715-44ea-a0ce-d9742b8f7be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1828675243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b7194e-02b3-4668-9eda-844013d87154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f21e422bf24b959140b013ddc9f55c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:33:08Z,use_quota=True,user_id='5e74c6be511f44b59a2cf5e55f725d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d21503a0-de77-4642-b5b3-689443e5d125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d21503a0-de77-4642-b5b3-689443e5d125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0901c7c6-fe44-4d5b-8924-ad68b395f255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0901c7c6-fe44-4d5b-8924-ad68b395f255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92b7194e-02b3-4668-9eda-844013d87154', 'volume_name': 'volume-92b7194e-02b3-4668-9eda-844013d87154', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42835ecc-d3f6-47d8-922d-bb0a5d8803c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42835ecc-d3f6-47d8-922d-bb0a5d8803c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d2e6a0b-ea2e-451e-8896-511889cc53c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:07 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Volume 92b7194e-02b3-4668-9eda-844013d87154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92b7194e-02b3-4668-9eda-844013d87154', 'volume_size': 1}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1828675243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b7194e-02b3-4668-9eda-844013d87154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f21e422bf24b959140b013ddc9f55c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:33:08Z,use_quota=True,user_id='5e74c6be511f44b59a2cf5e55f725d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Creating volume 92b7194e-02b3-4668-9eda-844013d87154 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:33:07 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5257b6f9-2fd3-4c24-9631-601f64ee4f60 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-53c7ab28-2168-441f-84a3-9dfdc81c05c8" released by "delete_snapshot" :: held 2.130s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 29 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>, <Thread(tpool_thread_0, started daemon 135438770624192)>, <Thread(tpool_thread_1, started daemon 135438762231488)>, <Thread(tpool_thread_2, started daemon 135438753838784)>, <Thread(tpool_thread_3, started daemon 135438745446080)>, <Thread(tpool_thread_4, started daemon 135438737053376)>, <Thread(tpool_thread_5, started daemon 135438728660672)>, <Thread(tpool_thread_6, started daemon 135438720267968)>, <Thread(tpool_thread_7, started daemon 135438711875264)>, <Thread(tpool_thread_8, started daemon 135438703466176)>, <Thread(tpool_thread_9, started daemon 135438695057088)>, <Thread(tpool_thread_10, started daemon 135438686648000)>, <Thread(tpool_thread_11, started daemon 135438678238912)>, <Thread(tpool_thread_12, started daemon 135438669829824)>, <Thread(tpool_thread_13, started daemon 135438661420736)>, <Thread(tpool_thread_14, started daemon 135438653011648)>, <Thread(tpool_thread_15, started daemon 135438644602560)>, <Thread(tpool_thread_16, started daemon 135438636193472)>, <Thread(tpool_thread_17, started daemon 135438627784384)>, <Thread(tpool_thread_18, started daemon 135438619375296)>, <Thread(tpool_thread_19, started daemon 135438610966208)>, <Thread(Rabbit-heartbeat, started daemon 135438772197760)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 16 16:33:07 devstack sudo[107219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154 1073741824
Sep 16 16:33:07 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-5257b6f9-2fd3-4c24-9631-601f64ee4f60 tempest-ProjectMemberTests-864664885 None] Created reservations ['0b29a018-e816-4385-bbc4-dbb44ba43218', '2ab120fe-f8f5-428b-a5b9-94b26340b9d4', '7f9bbd9f-da31-4ebb-a1df-c92511d8d2f5', '1b44a8f1-80d5-429d-af19-c343a277700d'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:33:07 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-5257b6f9-2fd3-4c24-9631-601f64ee4f60 tempest-ProjectMemberTests-864664885 None] Delete snapshot completed successfully.
Sep 16 16:33:07 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-5257b6f9-2fd3-4c24-9631-601f64ee4f60 tempest-ProjectMemberTests-864664885 None] Lock "cinder-bfa36ece-22e3-45b8-83aa-7d64cf01d7b1-delete_snapshot" released by "delete_snapshot" :: held 2.303s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:08 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154 1073741824" returned: 0 in 0.457s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:08 devstack sudo[107224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154
Sep 16 16:33:08 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:08 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154" returned: 0 in 0.266s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:08 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:33:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d2e6a0b-ea2e-451e-8896-511889cc53c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92b7194e-02b3-4668-9eda-844013d87154', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e6c20e-8a6f-4c1d-93b6-4d5bfe661f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:08 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Volume volume-92b7194e-02b3-4668-9eda-844013d87154 (92b7194e-02b3-4668-9eda-844013d87154): created successfully
Sep 16 16:33:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e6c20e-8a6f-4c1d-93b6-4d5bfe661f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:08 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Flow 'volume_create_manager' (2f6ee371-3b27-4fee-b03d-d1468f9da412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:33:08 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-a0b6f48d-0cfe-469a-a8b8-140acbbc7ebb tempest-ProjectReaderTests-1980496335 None] Created volume successfully.
Sep 16 16:33:08 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-8e379ea0-5e43-46af-a0e5-dfe6ae8e509c tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-53c7ab28-2168-441f-84a3-9dfdc81c05c8-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:08 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-8e379ea0-5e43-46af-a0e5-dfe6ae8e509c tempest-ProjectMemberTests-864664885 None] Lock "cinder-53c7ab28-2168-441f-84a3-9dfdc81c05c8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:08 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-8e379ea0-5e43-46af-a0e5-dfe6ae8e509c tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-53c7ab28-2168-441f-84a3-9dfdc81c05c8" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:08 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-8e379ea0-5e43-46af-a0e5-dfe6ae8e509c tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-53c7ab28-2168-441f-84a3-9dfdc81c05c8" acquired by "delete_volume" :: waited 0.015s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:08 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b3a7ce-6263-4f0d-a400-f11273a9eeb5]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:08 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8e379ea0-5e43-46af-a0e5-dfe6ae8e509c tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:09 devstack sudo[107227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8
Sep 16 16:33:09 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:09 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8e379ea0-5e43-46af-a0e5-dfe6ae8e509c tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8" returned: 0 in 0.369s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8e379ea0-5e43-46af-a0e5-dfe6ae8e509c tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:09 devstack sudo[107232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8
Sep 16 16:33:09 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:09 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8e379ea0-5e43-46af-a0e5-dfe6ae8e509c tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-53c7ab28-2168-441f-84a3-9dfdc81c05c8" returned: 0 in 0.247s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:09 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-8e379ea0-5e43-46af-a0e5-dfe6ae8e509c tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-53c7ab28-2168-441f-84a3-9dfdc81c05c8" released by "delete_volume" :: held 0.677s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:09 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-8e379ea0-5e43-46af-a0e5-dfe6ae8e509c tempest-ProjectMemberTests-864664885 None] Created reservations ['31c8efdf-18ca-4efa-839c-2c218b5df440', 'c92b2258-f7ef-4509-ba29-53eed0f9951b', 'f2e43f51-5afd-4fc6-8f59-d201dfbbee2f', '2f0d2da9-31f6-447e-912b-231d53657eff'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:33:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8e379ea0-5e43-46af-a0e5-dfe6ae8e509c tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8e379ea0-5e43-46af-a0e5-dfe6ae8e509c tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8e379ea0-5e43-46af-a0e5-dfe6ae8e509c tempest-ProjectMemberTests-864664885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:33:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8e379ea0-5e43-46af-a0e5-dfe6ae8e509c tempest-ProjectMemberTests-864664885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:33:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8e379ea0-5e43-46af-a0e5-dfe6ae8e509c tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8e379ea0-5e43-46af-a0e5-dfe6ae8e509c tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:09 devstack sudo[107235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:33:09 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-68fde808-4ce2-4fd4-8a4d-952e88be3f2f tempest-ProjectReaderTests-1980496335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:09 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-68fde808-4ce2-4fd4-8a4d-952e88be3f2f tempest-ProjectReaderTests-1980496335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:09 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-68fde808-4ce2-4fd4-8a4d-952e88be3f2f tempest-ProjectReaderTests-1980496335 None] Creating offline snapshot f5ddfed2-115f-4103-ab06-08ca93e55d0e of volume 92b7194e-02b3-4668-9eda-844013d87154 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:33:09 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8e5608-7888-4902-a236-bde040929da6]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-68fde808-4ce2-4fd4-8a4d-952e88be3f2f tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:10 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8e379ea0-5e43-46af-a0e5-dfe6ae8e509c tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.305s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:10 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-8e379ea0-5e43-46af-a0e5-dfe6ae8e509c tempest-ProjectMemberTests-864664885 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:33:10 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-8e379ea0-5e43-46af-a0e5-dfe6ae8e509c tempest-ProjectMemberTests-864664885 None] Deleted volume successfully.
Sep 16 16:33:10 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-8e379ea0-5e43-46af-a0e5-dfe6ae8e509c tempest-ProjectMemberTests-864664885 None] Lock "cinder-53c7ab28-2168-441f-84a3-9dfdc81c05c8-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:10 devstack sudo[107238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154
Sep 16 16:33:10 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:10 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-68fde808-4ce2-4fd4-8a4d-952e88be3f2f tempest-ProjectReaderTests-1980496335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154" returned: 0 in 0.416s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-68fde808-4ce2-4fd4-8a4d-952e88be3f2f tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.f5ddfed2-115f-4103-ab06-08ca93e55d0e 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:10 devstack sudo[107243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.f5ddfed2-115f-4103-ab06-08ca93e55d0e 1G
Sep 16 16:33:10 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:10 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:33:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Flow 'volume_create_manager' (a1487ce8-8c17-469a-b86a-38506d9d0df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:33:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2315c295-895a-411f-9a97-a9a9f8b91fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2315c295-895a-411f-9a97-a9a9f8b91fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-285561140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4fd7e1-fa5d-41b2-899c-51e577e84d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4be84013f847d4a2f15dde740a2536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:33:10Z,use_quota=True,user_id='ae825737116546298fd942e8502abe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb23ef5-be8d-4603-879e-eb60e27d00fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bb23ef5-be8d-4603-879e-eb60e27d00fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc1470e4-6d49-4796-bcff-ad1c7deaf6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc1470e4-6d49-4796-bcff-ad1c7deaf6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb4fd7e1-fa5d-41b2-899c-51e577e84d2b', 'volume_name': 'volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad5a412-3b8d-4379-b634-0f006e4996c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad5a412-3b8d-4379-b634-0f006e4996c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:10 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b579ebd4-5236-4248-b533-15d05076b293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:10 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Volume cb4fd7e1-fa5d-41b2-899c-51e577e84d2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b', 'volume_size': 1}
Sep 16 16:33:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:10 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-68fde808-4ce2-4fd4-8a4d-952e88be3f2f tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.f5ddfed2-115f-4103-ab06-08ca93e55d0e 1G" returned: 0 in 0.418s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:10 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-68fde808-4ce2-4fd4-8a4d-952e88be3f2f tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92b7194e-02b3-4668-9eda-844013d87154 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.f5ddfed2-115f-4103-ab06-08ca93e55d0e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:10 devstack sudo[107248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92b7194e-02b3-4668-9eda-844013d87154 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.f5ddfed2-115f-4103-ab06-08ca93e55d0e
Sep 16 16:33:10 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:11 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-68fde808-4ce2-4fd4-8a4d-952e88be3f2f tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92b7194e-02b3-4668-9eda-844013d87154 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.f5ddfed2-115f-4103-ab06-08ca93e55d0e" returned: 0 in 0.298s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:11 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-68fde808-4ce2-4fd4-8a4d-952e88be3f2f tempest-ProjectReaderTests-1980496335 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.f5ddfed2-115f-4103-ab06-08ca93e55d0e is being set with open permissions: ugo+rw
Sep 16 16:33:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-68fde808-4ce2-4fd4-8a4d-952e88be3f2f tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.f5ddfed2-115f-4103-ab06-08ca93e55d0e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:11 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.f5ddfed2-115f-4103-ab06-08ca93e55d0e
Sep 16 16:33:11 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:11 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-68fde808-4ce2-4fd4-8a4d-952e88be3f2f tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.f5ddfed2-115f-4103-ab06-08ca93e55d0e" returned: 0 in 0.239s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-68fde808-4ce2-4fd4-8a4d-952e88be3f2f tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:11 devstack sudo[107257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.info
Sep 16 16:33:11 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:11 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-68fde808-4ce2-4fd4-8a4d-952e88be3f2f tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.info" returned: 0 in 0.261s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:11 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-68fde808-4ce2-4fd4-8a4d-952e88be3f2f tempest-ProjectReaderTests-1980496335 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.info is being set with open permissions: ugo+rw
Sep 16 16:33:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-68fde808-4ce2-4fd4-8a4d-952e88be3f2f tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:11 devstack sudo[107260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.info
Sep 16 16:33:11 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:11 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-68fde808-4ce2-4fd4-8a4d-952e88be3f2f tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.info" returned: 0 in 0.256s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-68fde808-4ce2-4fd4-8a4d-952e88be3f2f tempest-ProjectReaderTests-1980496335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.338s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-285561140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4fd7e1-fa5d-41b2-899c-51e577e84d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4be84013f847d4a2f15dde740a2536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:33:10Z,use_quota=True,user_id='ae825737116546298fd942e8502abe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:33:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Creating volume cb4fd7e1-fa5d-41b2-899c-51e577e84d2b {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:33:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:33:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:33:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:11 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:33:11 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:33:11 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:11 devstack sudo[107263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b 1073741824
Sep 16 16:33:11 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:11 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-68fde808-4ce2-4fd4-8a4d-952e88be3f2f tempest-ProjectReaderTests-1980496335 None] Create snapshot completed successfully
Sep 16 16:33:12 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b 1073741824" returned: 0 in 0.454s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:12 devstack sudo[107269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b
Sep 16 16:33:12 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:12 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b" returned: 0 in 0.298s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:12 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:33:12 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b579ebd4-5236-4248-b533-15d05076b293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00162fa9-612d-4a50-bbc8-dcafda36321f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:12 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Volume volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b (cb4fd7e1-fa5d-41b2-899c-51e577e84d2b): created successfully
Sep 16 16:33:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00162fa9-612d-4a50-bbc8-dcafda36321f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:12 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Flow 'volume_create_manager' (a1487ce8-8c17-469a-b86a-38506d9d0df2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:33:12 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-50f2827d-b4db-4f56-b673-379a8eeff4e9 tempest-ProjectMemberTests-864664885 None] Created volume successfully.
Sep 16 16:33:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-75dbad2b-3504-4f0c-b084-14a80b4bb55d tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-f5ddfed2-115f-4103-ab06-08ca93e55d0e-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-75dbad2b-3504-4f0c-b084-14a80b4bb55d tempest-ProjectReaderTests-1980496335 None] Lock "cinder-f5ddfed2-115f-4103-ab06-08ca93e55d0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-75dbad2b-3504-4f0c-b084-14a80b4bb55d tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-quobyte-92b7194e-02b3-4668-9eda-844013d87154" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-75dbad2b-3504-4f0c-b084-14a80b4bb55d tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-92b7194e-02b3-4668-9eda-844013d87154" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-75dbad2b-3504-4f0c-b084-14a80b4bb55d tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-quobyte-f5ddfed2-115f-4103-ab06-08ca93e55d0e" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:13 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-75dbad2b-3504-4f0c-b084-14a80b4bb55d tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-f5ddfed2-115f-4103-ab06-08ca93e55d0e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-75dbad2b-3504-4f0c-b084-14a80b4bb55d tempest-ProjectReaderTests-1980496335 None] Deleting offline snapshot f5ddfed2-115f-4103-ab06-08ca93e55d0e of volume 92b7194e-02b3-4668-9eda-844013d87154 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:33:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-75dbad2b-3504-4f0c-b084-14a80b4bb55d tempest-ProjectReaderTests-1980496335 None] snapshot_file for this snap is: volume-92b7194e-02b3-4668-9eda-844013d87154.f5ddfed2-115f-4103-ab06-08ca93e55d0e {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:33:13 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b407ea-3416-43b1-927b-76269a3c48f5]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-75dbad2b-3504-4f0c-b084-14a80b4bb55d tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.f5ddfed2-115f-4103-ab06-08ca93e55d0e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:13 devstack sudo[107275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.f5ddfed2-115f-4103-ab06-08ca93e55d0e
Sep 16 16:33:13 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:13 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-75dbad2b-3504-4f0c-b084-14a80b4bb55d tempest-ProjectReaderTests-1980496335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.f5ddfed2-115f-4103-ab06-08ca93e55d0e" returned: 0 in 0.406s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-75dbad2b-3504-4f0c-b084-14a80b4bb55d tempest-ProjectReaderTests-1980496335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92b7194e-02b3-4668-9eda-844013d87154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:33:13 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd31a3e-f6eb-45b5-81de-8db9550a25f4]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-75dbad2b-3504-4f0c-b084-14a80b4bb55d tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:13 devstack sudo[107283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154
Sep 16 16:33:13 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-aab57f1c-105e-40c4-8d18-a034d2858806 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-aab57f1c-105e-40c4-8d18-a034d2858806 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:13 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-aab57f1c-105e-40c4-8d18-a034d2858806 tempest-ProjectMemberTests-864664885 None] Creating offline snapshot a3ae6a88-acfc-481e-8e50-93bba20da219 of volume cb4fd7e1-fa5d-41b2-899c-51e577e84d2b {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:33:13 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6c8a9e-b1e3-4c1a-a6bf-50200efccbef]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:13 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-aab57f1c-105e-40c4-8d18-a034d2858806 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:14 devstack sudo[107285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b
Sep 16 16:33:14 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:14 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-75dbad2b-3504-4f0c-b084-14a80b4bb55d tempest-ProjectReaderTests-1980496335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154" returned: 0 in 0.438s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-75dbad2b-3504-4f0c-b084-14a80b4bb55d tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.f5ddfed2-115f-4103-ab06-08ca93e55d0e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:14 devstack sudo[107290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.f5ddfed2-115f-4103-ab06-08ca93e55d0e
Sep 16 16:33:14 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:14 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-aab57f1c-105e-40c4-8d18-a034d2858806 tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b" returned: 0 in 0.401s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-aab57f1c-105e-40c4-8d18-a034d2858806 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.a3ae6a88-acfc-481e-8e50-93bba20da219 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:14 devstack sudo[107297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.a3ae6a88-acfc-481e-8e50-93bba20da219 1G
Sep 16 16:33:14 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:14 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-75dbad2b-3504-4f0c-b084-14a80b4bb55d tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.f5ddfed2-115f-4103-ab06-08ca93e55d0e" returned: 0 in 0.373s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-75dbad2b-3504-4f0c-b084-14a80b4bb55d tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.f5ddfed2-115f-4103-ab06-08ca93e55d0e {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:14 devstack sudo[107301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.f5ddfed2-115f-4103-ab06-08ca93e55d0e
Sep 16 16:33:14 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:14 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-75dbad2b-3504-4f0c-b084-14a80b4bb55d tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154.f5ddfed2-115f-4103-ab06-08ca93e55d0e" returned: 0 in 0.308s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:14 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-aab57f1c-105e-40c4-8d18-a034d2858806 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.a3ae6a88-acfc-481e-8e50-93bba20da219 1G" returned: 0 in 0.482s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:14 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-aab57f1c-105e-40c4-8d18-a034d2858806 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.a3ae6a88-acfc-481e-8e50-93bba20da219 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-75dbad2b-3504-4f0c-b084-14a80b4bb55d tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-f5ddfed2-115f-4103-ab06-08ca93e55d0e" released by "_delete_snapshot" :: held 1.668s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:14 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-75dbad2b-3504-4f0c-b084-14a80b4bb55d tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-92b7194e-02b3-4668-9eda-844013d87154" released by "delete_snapshot" :: held 1.700s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:14 devstack sudo[107307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.a3ae6a88-acfc-481e-8e50-93bba20da219
Sep 16 16:33:14 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:14 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-75dbad2b-3504-4f0c-b084-14a80b4bb55d tempest-ProjectReaderTests-1980496335 None] Created reservations ['d7051e33-f29f-4cd5-9b41-1917d5ca1f48', '461baf34-6323-4144-a2a4-00c573fb8005', '5ef34f7d-0f75-4d04-af2e-e15c543c8cf0', 'd953ff12-dd10-4cd2-80dd-1ce1a59d26a8'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:33:15 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-75dbad2b-3504-4f0c-b084-14a80b4bb55d tempest-ProjectReaderTests-1980496335 None] Delete snapshot completed successfully.
Sep 16 16:33:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-75dbad2b-3504-4f0c-b084-14a80b4bb55d tempest-ProjectReaderTests-1980496335 None] Lock "cinder-f5ddfed2-115f-4103-ab06-08ca93e55d0e-delete_snapshot" released by "delete_snapshot" :: held 1.870s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:15 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-aab57f1c-105e-40c4-8d18-a034d2858806 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.a3ae6a88-acfc-481e-8e50-93bba20da219" returned: 0 in 0.343s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:15 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-aab57f1c-105e-40c4-8d18-a034d2858806 tempest-ProjectMemberTests-864664885 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.a3ae6a88-acfc-481e-8e50-93bba20da219 is being set with open permissions: ugo+rw
Sep 16 16:33:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-aab57f1c-105e-40c4-8d18-a034d2858806 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.a3ae6a88-acfc-481e-8e50-93bba20da219 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:15 devstack sudo[107312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.a3ae6a88-acfc-481e-8e50-93bba20da219
Sep 16 16:33:15 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1d1424f8-31e6-4078-84d7-73320490b1cf tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-92b7194e-02b3-4668-9eda-844013d87154-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1d1424f8-31e6-4078-84d7-73320490b1cf tempest-ProjectReaderTests-1980496335 None] Lock "cinder-92b7194e-02b3-4668-9eda-844013d87154-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1d1424f8-31e6-4078-84d7-73320490b1cf tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-quobyte-92b7194e-02b3-4668-9eda-844013d87154" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:15 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1d1424f8-31e6-4078-84d7-73320490b1cf tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-92b7194e-02b3-4668-9eda-844013d87154" acquired by "delete_volume" :: waited 0.015s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:15 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3ebf49-bdea-4adf-91d9-823bae4e15e9]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d1424f8-31e6-4078-84d7-73320490b1cf tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:15 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-aab57f1c-105e-40c4-8d18-a034d2858806 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.a3ae6a88-acfc-481e-8e50-93bba20da219" returned: 0 in 0.280s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-aab57f1c-105e-40c4-8d18-a034d2858806 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:15 devstack sudo[107316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.info
Sep 16 16:33:15 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:15 devstack sudo[107315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154
Sep 16 16:33:15 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:15 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-aab57f1c-105e-40c4-8d18-a034d2858806 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.info" returned: 0 in 0.273s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:15 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-aab57f1c-105e-40c4-8d18-a034d2858806 tempest-ProjectMemberTests-864664885 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.info is being set with open permissions: ugo+rw
Sep 16 16:33:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-aab57f1c-105e-40c4-8d18-a034d2858806 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:15 devstack sudo[107322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.info
Sep 16 16:33:15 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:15 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d1424f8-31e6-4078-84d7-73320490b1cf tempest-ProjectReaderTests-1980496335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154" returned: 0 in 0.389s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:15 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d1424f8-31e6-4078-84d7-73320490b1cf tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:15 devstack sudo[107325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154
Sep 16 16:33:15 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:16 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-aab57f1c-105e-40c4-8d18-a034d2858806 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.info" returned: 0 in 0.285s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-aab57f1c-105e-40c4-8d18-a034d2858806 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.165s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:16 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-aab57f1c-105e-40c4-8d18-a034d2858806 tempest-ProjectMemberTests-864664885 None] Create snapshot completed successfully
Sep 16 16:33:16 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d1424f8-31e6-4078-84d7-73320490b1cf tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-92b7194e-02b3-4668-9eda-844013d87154" returned: 0 in 0.280s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1d1424f8-31e6-4078-84d7-73320490b1cf tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-92b7194e-02b3-4668-9eda-844013d87154" released by "delete_volume" :: held 0.740s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:16 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-1d1424f8-31e6-4078-84d7-73320490b1cf tempest-ProjectReaderTests-1980496335 None] Created reservations ['3a7e4d7a-36eb-4f94-8359-4f572ffa709d', 'f226aff7-279c-419c-aa6e-a6aed28e7548', '24c8142d-db68-448e-bb90-7ea183ae62a7', 'e69c9759-9c78-4ed0-8adc-29177117058f'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:33:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1d1424f8-31e6-4078-84d7-73320490b1cf tempest-ProjectReaderTests-1980496335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1d1424f8-31e6-4078-84d7-73320490b1cf tempest-ProjectReaderTests-1980496335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1d1424f8-31e6-4078-84d7-73320490b1cf tempest-ProjectReaderTests-1980496335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:33:16 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-1d1424f8-31e6-4078-84d7-73320490b1cf tempest-ProjectReaderTests-1980496335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:33:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-1d1424f8-31e6-4078-84d7-73320490b1cf tempest-ProjectReaderTests-1980496335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d1424f8-31e6-4078-84d7-73320490b1cf tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:16 devstack sudo[107329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:33:16 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:16 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:16 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-1d1424f8-31e6-4078-84d7-73320490b1cf tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.273s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:16 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-1d1424f8-31e6-4078-84d7-73320490b1cf tempest-ProjectReaderTests-1980496335 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:33:16 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-1d1424f8-31e6-4078-84d7-73320490b1cf tempest-ProjectReaderTests-1980496335 None] Deleted volume successfully.
Sep 16 16:33:16 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-1d1424f8-31e6-4078-84d7-73320490b1cf tempest-ProjectReaderTests-1980496335 None] Lock "cinder-92b7194e-02b3-4668-9eda-844013d87154-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Flow 'volume_create_manager' (98ad62d4-8c81-4708-80bf-0ca5a8066c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (093bd635-44b8-4c59-9016-6d14ff769a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (093bd635-44b8-4c59-9016-6d14ff769a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1101381811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7365d08f-04f8-4711-b261-ca1947cb6641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f21e422bf24b959140b013ddc9f55c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:33:17Z,use_quota=True,user_id='5e74c6be511f44b59a2cf5e55f725d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6753ec-1c03-415c-95a6-0e07c32ba1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6753ec-1c03-415c-95a6-0e07c32ba1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c44f1fac-3ca4-4bae-b952-38a93132d1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c44f1fac-3ca4-4bae-b952-38a93132d1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7365d08f-04f8-4711-b261-ca1947cb6641', 'volume_name': 'volume-7365d08f-04f8-4711-b261-ca1947cb6641', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc833aa4-07d0-4711-b52e-02e53c6ad125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc833aa4-07d0-4711-b52e-02e53c6ad125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1488aef-2d8d-406c-99db-9b3eb17d02d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:17 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Volume 7365d08f-04f8-4711-b261-ca1947cb6641: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7365d08f-04f8-4711-b261-ca1947cb6641', 'volume_size': 1}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1101381811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7365d08f-04f8-4711-b261-ca1947cb6641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f21e422bf24b959140b013ddc9f55c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:33:17Z,use_quota=True,user_id='5e74c6be511f44b59a2cf5e55f725d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Creating volume 7365d08f-04f8-4711-b261-ca1947cb6641 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:33:17 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-30f87c6d-640d-4ca6-9a60-36dd1258de5b tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-a3ae6a88-acfc-481e-8e50-93bba20da219-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:17 devstack sudo[107332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641 1073741824
Sep 16 16:33:17 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-30f87c6d-640d-4ca6-9a60-36dd1258de5b tempest-ProjectMemberTests-864664885 None] Lock "cinder-a3ae6a88-acfc-481e-8e50-93bba20da219-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-30f87c6d-640d-4ca6-9a60-36dd1258de5b tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-30f87c6d-640d-4ca6-9a60-36dd1258de5b tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-30f87c6d-640d-4ca6-9a60-36dd1258de5b tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-a3ae6a88-acfc-481e-8e50-93bba20da219" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-30f87c6d-640d-4ca6-9a60-36dd1258de5b tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-a3ae6a88-acfc-481e-8e50-93bba20da219" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-30f87c6d-640d-4ca6-9a60-36dd1258de5b tempest-ProjectMemberTests-864664885 None] Deleting offline snapshot a3ae6a88-acfc-481e-8e50-93bba20da219 of volume cb4fd7e1-fa5d-41b2-899c-51e577e84d2b {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-30f87c6d-640d-4ca6-9a60-36dd1258de5b tempest-ProjectMemberTests-864664885 None] snapshot_file for this snap is: volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.a3ae6a88-acfc-481e-8e50-93bba20da219 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd37784-0bfe-4a56-9794-1f1166271a8e]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-30f87c6d-640d-4ca6-9a60-36dd1258de5b tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.a3ae6a88-acfc-481e-8e50-93bba20da219 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:17 devstack sudo[107334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.a3ae6a88-acfc-481e-8e50-93bba20da219
Sep 16 16:33:17 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:17 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641 1073741824" returned: 0 in 0.480s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:17 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-30f87c6d-640d-4ca6-9a60-36dd1258de5b tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.a3ae6a88-acfc-481e-8e50-93bba20da219" returned: 0 in 0.395s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-30f87c6d-640d-4ca6-9a60-36dd1258de5b tempest-ProjectMemberTests-864664885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[42817445-23d1-4597-a7b0-c34f563d1d5e]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-30f87c6d-640d-4ca6-9a60-36dd1258de5b tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:17 devstack sudo[107345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641
Sep 16 16:33:17 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:17 devstack sudo[107344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b
Sep 16 16:33:17 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:17 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641" returned: 0 in 0.293s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1488aef-2d8d-406c-99db-9b3eb17d02d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7365d08f-04f8-4711-b261-ca1947cb6641', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176e1c2b-b3bf-4fd5-9a7d-e346ac01f969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:17 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Volume volume-7365d08f-04f8-4711-b261-ca1947cb6641 (7365d08f-04f8-4711-b261-ca1947cb6641): created successfully
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176e1c2b-b3bf-4fd5-9a7d-e346ac01f969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:17 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Flow 'volume_create_manager' (98ad62d4-8c81-4708-80bf-0ca5a8066c31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:33:18 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-4ccc9b1d-57b0-4582-8210-3da2f61b0df0 tempest-ProjectReaderTests-1980496335 None] Created volume successfully.
Sep 16 16:33:18 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-30f87c6d-640d-4ca6-9a60-36dd1258de5b tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b" returned: 0 in 0.411s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-30f87c6d-640d-4ca6-9a60-36dd1258de5b tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.a3ae6a88-acfc-481e-8e50-93bba20da219 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:18 devstack sudo[107352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.a3ae6a88-acfc-481e-8e50-93bba20da219
Sep 16 16:33:18 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:18 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-30f87c6d-640d-4ca6-9a60-36dd1258de5b tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.a3ae6a88-acfc-481e-8e50-93bba20da219" returned: 0 in 0.359s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-30f87c6d-640d-4ca6-9a60-36dd1258de5b tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.a3ae6a88-acfc-481e-8e50-93bba20da219 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:18 devstack sudo[107357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.a3ae6a88-acfc-481e-8e50-93bba20da219
Sep 16 16:33:18 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:18 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:18 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-30f87c6d-640d-4ca6-9a60-36dd1258de5b tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b.a3ae6a88-acfc-481e-8e50-93bba20da219" returned: 0 in 0.253s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-30f87c6d-640d-4ca6-9a60-36dd1258de5b tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-a3ae6a88-acfc-481e-8e50-93bba20da219" released by "_delete_snapshot" :: held 1.525s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-30f87c6d-640d-4ca6-9a60-36dd1258de5b tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b" released by "delete_snapshot" :: held 1.552s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:18 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-30f87c6d-640d-4ca6-9a60-36dd1258de5b tempest-ProjectMemberTests-864664885 None] Created reservations ['0900df9e-8ca5-4305-99dd-e12bf2a27071', 'c312e546-6c18-4074-b290-dc5b3944eff8', '8f888077-2416-477b-99c1-3a3445f76742', '3c01062f-aec1-48a2-9380-a715907e6e8e'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:33:18 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-30f87c6d-640d-4ca6-9a60-36dd1258de5b tempest-ProjectMemberTests-864664885 None] Delete snapshot completed successfully.
Sep 16 16:33:18 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-30f87c6d-640d-4ca6-9a60-36dd1258de5b tempest-ProjectMemberTests-864664885 None] Lock "cinder-a3ae6a88-acfc-481e-8e50-93bba20da219-delete_snapshot" released by "delete_snapshot" :: held 1.686s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4d1bfc5e-f0f8-4b41-bdd1-ccd2557a329a tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4d1bfc5e-f0f8-4b41-bdd1-ccd2557a329a tempest-ProjectMemberTests-864664885 None] Lock "cinder-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-04e7838a-ef74-4ad1-a41a-f61ddd3717e0 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-04e7838a-ef74-4ad1-a41a-f61ddd3717e0 tempest-ProjectReaderTests-1980496335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:19 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-04e7838a-ef74-4ad1-a41a-f61ddd3717e0 tempest-ProjectReaderTests-1980496335 None] Creating offline snapshot f75255a4-4323-433c-9d0e-f8d61be642f3 of volume 7365d08f-04f8-4711-b261-ca1947cb6641 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:33:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4d1bfc5e-f0f8-4b41-bdd1-ccd2557a329a tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:19 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4d1bfc5e-f0f8-4b41-bdd1-ccd2557a329a tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b" acquired by "delete_volume" :: waited 0.013s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:19 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a044f3-4440-4b1e-a1da-f0d475388ce7]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-04e7838a-ef74-4ad1-a41a-f61ddd3717e0 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:19 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9e6d3b-e926-413e-b707-85fb94613cc6]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4d1bfc5e-f0f8-4b41-bdd1-ccd2557a329a tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:19 devstack sudo[107360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641
Sep 16 16:33:19 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:19 devstack sudo[107361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b
Sep 16 16:33:19 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:19 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-04e7838a-ef74-4ad1-a41a-f61ddd3717e0 tempest-ProjectReaderTests-1980496335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641" returned: 0 in 0.375s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-04e7838a-ef74-4ad1-a41a-f61ddd3717e0 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.f75255a4-4323-433c-9d0e-f8d61be642f3 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:19 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4d1bfc5e-f0f8-4b41-bdd1-ccd2557a329a tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b" returned: 0 in 0.372s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:19 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4d1bfc5e-f0f8-4b41-bdd1-ccd2557a329a tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:19 devstack sudo[107371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.f75255a4-4323-433c-9d0e-f8d61be642f3 1G
Sep 16 16:33:19 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:19 devstack sudo[107372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b
Sep 16 16:33:19 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:19 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4d1bfc5e-f0f8-4b41-bdd1-ccd2557a329a tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b" returned: 0 in 0.260s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4d1bfc5e-f0f8-4b41-bdd1-ccd2557a329a tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b" released by "delete_volume" :: held 0.699s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-4d1bfc5e-f0f8-4b41-bdd1-ccd2557a329a tempest-ProjectMemberTests-864664885 None] Created reservations ['92c09efc-04b2-4a01-a2eb-9ebe110bb096', 'adb5dbcb-980e-4495-8547-d923bf3a2812', '0a3e7e7a-0aba-47f5-b68f-fc849a9b90cb', 'cbec67dd-5cc2-43b8-a859-9e990d301b31'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4d1bfc5e-f0f8-4b41-bdd1-ccd2557a329a tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4d1bfc5e-f0f8-4b41-bdd1-ccd2557a329a tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4d1bfc5e-f0f8-4b41-bdd1-ccd2557a329a tempest-ProjectMemberTests-864664885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4d1bfc5e-f0f8-4b41-bdd1-ccd2557a329a tempest-ProjectMemberTests-864664885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4d1bfc5e-f0f8-4b41-bdd1-ccd2557a329a tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4d1bfc5e-f0f8-4b41-bdd1-ccd2557a329a tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:20 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-04e7838a-ef74-4ad1-a41a-f61ddd3717e0 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.f75255a4-4323-433c-9d0e-f8d61be642f3 1G" returned: 0 in 0.450s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-04e7838a-ef74-4ad1-a41a-f61ddd3717e0 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7365d08f-04f8-4711-b261-ca1947cb6641 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.f75255a4-4323-433c-9d0e-f8d61be642f3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:20 devstack sudo[107380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:33:20 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:20 devstack sudo[107381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7365d08f-04f8-4711-b261-ca1947cb6641 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.f75255a4-4323-433c-9d0e-f8d61be642f3
Sep 16 16:33:20 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:20 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4d1bfc5e-f0f8-4b41-bdd1-ccd2557a329a tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.253s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4d1bfc5e-f0f8-4b41-bdd1-ccd2557a329a tempest-ProjectMemberTests-864664885 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:33:20 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-4d1bfc5e-f0f8-4b41-bdd1-ccd2557a329a tempest-ProjectMemberTests-864664885 None] Deleted volume successfully.
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-4d1bfc5e-f0f8-4b41-bdd1-ccd2557a329a tempest-ProjectMemberTests-864664885 None] Lock "cinder-cb4fd7e1-fa5d-41b2-899c-51e577e84d2b-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:20 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-04e7838a-ef74-4ad1-a41a-f61ddd3717e0 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7365d08f-04f8-4711-b261-ca1947cb6641 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.f75255a4-4323-433c-9d0e-f8d61be642f3" returned: 0 in 0.310s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:20 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-04e7838a-ef74-4ad1-a41a-f61ddd3717e0 tempest-ProjectReaderTests-1980496335 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.f75255a4-4323-433c-9d0e-f8d61be642f3 is being set with open permissions: ugo+rw
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-04e7838a-ef74-4ad1-a41a-f61ddd3717e0 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.f75255a4-4323-433c-9d0e-f8d61be642f3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:20 devstack sudo[107388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.f75255a4-4323-433c-9d0e-f8d61be642f3
Sep 16 16:33:20 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:20 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-04e7838a-ef74-4ad1-a41a-f61ddd3717e0 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.f75255a4-4323-433c-9d0e-f8d61be642f3" returned: 0 in 0.272s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-04e7838a-ef74-4ad1-a41a-f61ddd3717e0 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:20 devstack sudo[107391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.info
Sep 16 16:33:20 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Flow 'volume_create_manager' (8170b5ad-3c58-4088-95c5-6772791d3742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d10948f-fbe8-4872-8afc-8d6aaa026769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d10948f-fbe8-4872-8afc-8d6aaa026769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1470574861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9312d58f-6324-404d-a6a4-0fdccfb09be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4be84013f847d4a2f15dde740a2536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:33:21Z,use_quota=True,user_id='ae825737116546298fd942e8502abe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29a016e-f32b-4f50-8f51-e869e7e5f05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29a016e-f32b-4f50-8f51-e869e7e5f05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d961db9d-2e14-41ca-a88f-abbd60bbfa69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d961db9d-2e14-41ca-a88f-abbd60bbfa69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9312d58f-6324-404d-a6a4-0fdccfb09be4', 'volume_name': 'volume-9312d58f-6324-404d-a6a4-0fdccfb09be4', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36fc20b6-4edc-4931-9bb6-85b196984206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36fc20b6-4edc-4931-9bb6-85b196984206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62a252e-360e-4515-8aff-7ce18c74773d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:20 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Volume 9312d58f-6324-404d-a6a4-0fdccfb09be4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9312d58f-6324-404d-a6a4-0fdccfb09be4', 'volume_size': 1}
Sep 16 16:33:20 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:21 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-04e7838a-ef74-4ad1-a41a-f61ddd3717e0 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.info" returned: 0 in 0.292s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:21 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-04e7838a-ef74-4ad1-a41a-f61ddd3717e0 tempest-ProjectReaderTests-1980496335 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.info is being set with open permissions: ugo+rw
Sep 16 16:33:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-04e7838a-ef74-4ad1-a41a-f61ddd3717e0 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:21 devstack sudo[107395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.info
Sep 16 16:33:21 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:21 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-04e7838a-ef74-4ad1-a41a-f61ddd3717e0 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.info" returned: 0 in 0.237s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-04e7838a-ef74-4ad1-a41a-f61ddd3717e0 tempest-ProjectReaderTests-1980496335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.075s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.369s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1470574861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9312d58f-6324-404d-a6a4-0fdccfb09be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4be84013f847d4a2f15dde740a2536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:33:21Z,use_quota=True,user_id='ae825737116546298fd942e8502abe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:33:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Creating volume 9312d58f-6324-404d-a6a4-0fdccfb09be4 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:33:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:33:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:33:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:21 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:33:21 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:33:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:21 devstack sudo[107398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4 1073741824
Sep 16 16:33:21 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:21 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-04e7838a-ef74-4ad1-a41a-f61ddd3717e0 tempest-ProjectReaderTests-1980496335 None] Create snapshot completed successfully
Sep 16 16:33:21 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4 1073741824" returned: 0 in 0.427s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:21 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:21 devstack sudo[107403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4
Sep 16 16:33:21 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:22 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4" returned: 0 in 0.247s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:33:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62a252e-360e-4515-8aff-7ce18c74773d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9312d58f-6324-404d-a6a4-0fdccfb09be4', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0e6caf-b557-4001-993b-e35e0b1e25f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:22 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Volume volume-9312d58f-6324-404d-a6a4-0fdccfb09be4 (9312d58f-6324-404d-a6a4-0fdccfb09be4): created successfully
Sep 16 16:33:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0e6caf-b557-4001-993b-e35e0b1e25f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:22 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Flow 'volume_create_manager' (8170b5ad-3c58-4088-95c5-6772791d3742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:33:22 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-e7ca12a4-dd57-4f2e-a3bf-f6def499863e tempest-ProjectMemberTests-864664885 None] Created volume successfully.
Sep 16 16:33:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d3498501-7154-4dd8-8a57-97be5e57bbcb tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-f75255a4-4323-433c-9d0e-f8d61be642f3-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d3498501-7154-4dd8-8a57-97be5e57bbcb tempest-ProjectReaderTests-1980496335 None] Lock "cinder-f75255a4-4323-433c-9d0e-f8d61be642f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d3498501-7154-4dd8-8a57-97be5e57bbcb tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-quobyte-7365d08f-04f8-4711-b261-ca1947cb6641" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d3498501-7154-4dd8-8a57-97be5e57bbcb tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-7365d08f-04f8-4711-b261-ca1947cb6641" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d3498501-7154-4dd8-8a57-97be5e57bbcb tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-quobyte-f75255a4-4323-433c-9d0e-f8d61be642f3" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:22 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d3498501-7154-4dd8-8a57-97be5e57bbcb tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-f75255a4-4323-433c-9d0e-f8d61be642f3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-d3498501-7154-4dd8-8a57-97be5e57bbcb tempest-ProjectReaderTests-1980496335 None] Deleting offline snapshot f75255a4-4323-433c-9d0e-f8d61be642f3 of volume 7365d08f-04f8-4711-b261-ca1947cb6641 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:33:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-d3498501-7154-4dd8-8a57-97be5e57bbcb tempest-ProjectReaderTests-1980496335 None] snapshot_file for this snap is: volume-7365d08f-04f8-4711-b261-ca1947cb6641.f75255a4-4323-433c-9d0e-f8d61be642f3 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:33:22 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f16fdf-07fe-4c23-abe3-a59e7a00aafe]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d3498501-7154-4dd8-8a57-97be5e57bbcb tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.f75255a4-4323-433c-9d0e-f8d61be642f3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:22 devstack sudo[107406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.f75255a4-4323-433c-9d0e-f8d61be642f3
Sep 16 16:33:22 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:22 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d3498501-7154-4dd8-8a57-97be5e57bbcb tempest-ProjectReaderTests-1980496335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.f75255a4-4323-433c-9d0e-f8d61be642f3" returned: 0 in 0.362s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:22 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-d3498501-7154-4dd8-8a57-97be5e57bbcb tempest-ProjectReaderTests-1980496335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7365d08f-04f8-4711-b261-ca1947cb6641(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:33:22 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d27534-07e7-4f2d-b8f1-aa1c3b62a87e]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:22 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d3498501-7154-4dd8-8a57-97be5e57bbcb tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:23 devstack sudo[107412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641
Sep 16 16:33:23 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-67e40a43-926e-47af-9c34-29441c1331b4 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-67e40a43-926e-47af-9c34-29441c1331b4 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:23 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-67e40a43-926e-47af-9c34-29441c1331b4 tempest-ProjectMemberTests-864664885 None] Creating offline snapshot 5ae89146-a4d8-4854-849c-4085f0d0380f of volume 9312d58f-6324-404d-a6a4-0fdccfb09be4 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:33:23 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[691e11a8-c695-47e2-9f3b-067893ba13f3]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-67e40a43-926e-47af-9c34-29441c1331b4 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:23 devstack sudo[107414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4
Sep 16 16:33:23 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:23 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d3498501-7154-4dd8-8a57-97be5e57bbcb tempest-ProjectReaderTests-1980496335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641" returned: 0 in 0.443s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d3498501-7154-4dd8-8a57-97be5e57bbcb tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.f75255a4-4323-433c-9d0e-f8d61be642f3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:23 devstack sudo[107419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.f75255a4-4323-433c-9d0e-f8d61be642f3
Sep 16 16:33:23 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:23 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-67e40a43-926e-47af-9c34-29441c1331b4 tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4" returned: 0 in 0.417s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-67e40a43-926e-47af-9c34-29441c1331b4 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.5ae89146-a4d8-4854-849c-4085f0d0380f 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:23 devstack sudo[107427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.5ae89146-a4d8-4854-849c-4085f0d0380f 1G
Sep 16 16:33:23 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:23 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d3498501-7154-4dd8-8a57-97be5e57bbcb tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.f75255a4-4323-433c-9d0e-f8d61be642f3" returned: 0 in 0.360s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d3498501-7154-4dd8-8a57-97be5e57bbcb tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.f75255a4-4323-433c-9d0e-f8d61be642f3 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:23 devstack sudo[107430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.f75255a4-4323-433c-9d0e-f8d61be642f3
Sep 16 16:33:23 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:23 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:23 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-d3498501-7154-4dd8-8a57-97be5e57bbcb tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641.f75255a4-4323-433c-9d0e-f8d61be642f3" returned: 0 in 0.282s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d3498501-7154-4dd8-8a57-97be5e57bbcb tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-f75255a4-4323-433c-9d0e-f8d61be642f3" released by "_delete_snapshot" :: held 1.560s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d3498501-7154-4dd8-8a57-97be5e57bbcb tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-7365d08f-04f8-4711-b261-ca1947cb6641" released by "delete_snapshot" :: held 1.582s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:24 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-67e40a43-926e-47af-9c34-29441c1331b4 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.5ae89146-a4d8-4854-849c-4085f0d0380f 1G" returned: 0 in 0.464s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-67e40a43-926e-47af-9c34-29441c1331b4 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9312d58f-6324-404d-a6a4-0fdccfb09be4 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.5ae89146-a4d8-4854-849c-4085f0d0380f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:24 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-d3498501-7154-4dd8-8a57-97be5e57bbcb tempest-ProjectReaderTests-1980496335 None] Created reservations ['87959d91-54d1-4fe6-9c2e-f206ef14709d', 'f4197c03-1412-4a95-82fa-38b67d6aa819', '8eca1453-ad63-4788-a907-64a2ca1b7f06', '876a3df9-4237-448e-a315-5385e0574f84'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:33:24 devstack sudo[107437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9312d58f-6324-404d-a6a4-0fdccfb09be4 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.5ae89146-a4d8-4854-849c-4085f0d0380f
Sep 16 16:33:24 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:24 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-d3498501-7154-4dd8-8a57-97be5e57bbcb tempest-ProjectReaderTests-1980496335 None] Delete snapshot completed successfully.
Sep 16 16:33:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-d3498501-7154-4dd8-8a57-97be5e57bbcb tempest-ProjectReaderTests-1980496335 None] Lock "cinder-f75255a4-4323-433c-9d0e-f8d61be642f3-delete_snapshot" released by "delete_snapshot" :: held 1.770s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:24 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-67e40a43-926e-47af-9c34-29441c1331b4 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9312d58f-6324-404d-a6a4-0fdccfb09be4 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.5ae89146-a4d8-4854-849c-4085f0d0380f" returned: 0 in 0.364s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:24 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-67e40a43-926e-47af-9c34-29441c1331b4 tempest-ProjectMemberTests-864664885 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.5ae89146-a4d8-4854-849c-4085f0d0380f is being set with open permissions: ugo+rw
Sep 16 16:33:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-67e40a43-926e-47af-9c34-29441c1331b4 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.5ae89146-a4d8-4854-849c-4085f0d0380f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:24 devstack sudo[107442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.5ae89146-a4d8-4854-849c-4085f0d0380f
Sep 16 16:33:24 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a834b202-1ccc-4c08-ba1a-41e018a35301 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-7365d08f-04f8-4711-b261-ca1947cb6641-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a834b202-1ccc-4c08-ba1a-41e018a35301 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-7365d08f-04f8-4711-b261-ca1947cb6641-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a834b202-1ccc-4c08-ba1a-41e018a35301 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-quobyte-7365d08f-04f8-4711-b261-ca1947cb6641" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:24 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a834b202-1ccc-4c08-ba1a-41e018a35301 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-7365d08f-04f8-4711-b261-ca1947cb6641" acquired by "delete_volume" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:24 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e29dbb-529b-42a9-8293-e8444d7861d7]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a834b202-1ccc-4c08-ba1a-41e018a35301 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:24 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-67e40a43-926e-47af-9c34-29441c1331b4 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.5ae89146-a4d8-4854-849c-4085f0d0380f" returned: 0 in 0.274s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:24 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-67e40a43-926e-47af-9c34-29441c1331b4 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:24 devstack sudo[107446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.info
Sep 16 16:33:24 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:24 devstack sudo[107445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641
Sep 16 16:33:24 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:25 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-67e40a43-926e-47af-9c34-29441c1331b4 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.info" returned: 0 in 0.256s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:25 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-67e40a43-926e-47af-9c34-29441c1331b4 tempest-ProjectMemberTests-864664885 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.info is being set with open permissions: ugo+rw
Sep 16 16:33:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-67e40a43-926e-47af-9c34-29441c1331b4 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:25 devstack sudo[107451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.info
Sep 16 16:33:25 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:25 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a834b202-1ccc-4c08-ba1a-41e018a35301 tempest-ProjectReaderTests-1980496335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641" returned: 0 in 0.399s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a834b202-1ccc-4c08-ba1a-41e018a35301 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:25 devstack sudo[107455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641
Sep 16 16:33:25 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:25 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-67e40a43-926e-47af-9c34-29441c1331b4 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.info" returned: 0 in 0.262s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-67e40a43-926e-47af-9c34-29441c1331b4 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.132s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:25 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-67e40a43-926e-47af-9c34-29441c1331b4 tempest-ProjectMemberTests-864664885 None] Create snapshot completed successfully
Sep 16 16:33:25 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a834b202-1ccc-4c08-ba1a-41e018a35301 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-7365d08f-04f8-4711-b261-ca1947cb6641" returned: 0 in 0.283s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:25 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a834b202-1ccc-4c08-ba1a-41e018a35301 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-7365d08f-04f8-4711-b261-ca1947cb6641" released by "delete_volume" :: held 0.747s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:25 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-a834b202-1ccc-4c08-ba1a-41e018a35301 tempest-ProjectReaderTests-1980496335 None] Created reservations ['de882509-a8a3-44a1-af74-c865c7c9a488', '16b03ada-dd91-4762-97c1-724992610a59', '393ecfb5-acf5-4a4b-b790-ccb091f71606', 'a5f08638-7630-48d8-82bf-da1a27c07b18'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:33:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a834b202-1ccc-4c08-ba1a-41e018a35301 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a834b202-1ccc-4c08-ba1a-41e018a35301 tempest-ProjectReaderTests-1980496335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-a834b202-1ccc-4c08-ba1a-41e018a35301 tempest-ProjectReaderTests-1980496335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:33:25 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-a834b202-1ccc-4c08-ba1a-41e018a35301 tempest-ProjectReaderTests-1980496335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:33:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-a834b202-1ccc-4c08-ba1a-41e018a35301 tempest-ProjectReaderTests-1980496335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a834b202-1ccc-4c08-ba1a-41e018a35301 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:25 devstack sudo[107459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:33:25 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:25 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:25 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a834b202-1ccc-4c08-ba1a-41e018a35301 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.260s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:25 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-a834b202-1ccc-4c08-ba1a-41e018a35301 tempest-ProjectReaderTests-1980496335 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:33:25 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-a834b202-1ccc-4c08-ba1a-41e018a35301 tempest-ProjectReaderTests-1980496335 None] Deleted volume successfully.
Sep 16 16:33:25 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a834b202-1ccc-4c08-ba1a-41e018a35301 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-7365d08f-04f8-4711-b261-ca1947cb6641-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Flow 'volume_create_manager' (0c151b4d-cd2b-4125-b65a-8341b96c826f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe7fd010-d2e8-415d-a4d1-106c7cd892d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe7fd010-d2e8-415d-a4d1-106c7cd892d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-609534439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba57bbca-63c1-439f-b485-be532fc2858b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f21e422bf24b959140b013ddc9f55c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:33:26Z,use_quota=True,user_id='5e74c6be511f44b59a2cf5e55f725d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6221d189-f88b-40ef-9e07-3ffa78b191e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6221d189-f88b-40ef-9e07-3ffa78b191e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29341d2-76de-49e1-93d0-24ef526f580f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29341d2-76de-49e1-93d0-24ef526f580f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba57bbca-63c1-439f-b485-be532fc2858b', 'volume_name': 'volume-ba57bbca-63c1-439f-b485-be532fc2858b', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21cf56ac-8a6d-4c53-9789-64bd5d934710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21cf56ac-8a6d-4c53-9789-64bd5d934710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18e2b4e-e40d-4787-89a7-64e36ac37621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:26 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Volume ba57bbca-63c1-439f-b485-be532fc2858b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba57bbca-63c1-439f-b485-be532fc2858b', 'volume_size': 1}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-609534439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba57bbca-63c1-439f-b485-be532fc2858b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f21e422bf24b959140b013ddc9f55c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:33:26Z,use_quota=True,user_id='5e74c6be511f44b59a2cf5e55f725d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Creating volume ba57bbca-63c1-439f-b485-be532fc2858b {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:33:26 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a2e782cf-9773-4ca9-8cda-5c2588d3945b tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-5ae89146-a4d8-4854-849c-4085f0d0380f-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:26 devstack sudo[107462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b 1073741824
Sep 16 16:33:26 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a2e782cf-9773-4ca9-8cda-5c2588d3945b tempest-ProjectMemberTests-864664885 None] Lock "cinder-5ae89146-a4d8-4854-849c-4085f0d0380f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a2e782cf-9773-4ca9-8cda-5c2588d3945b tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-9312d58f-6324-404d-a6a4-0fdccfb09be4" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a2e782cf-9773-4ca9-8cda-5c2588d3945b tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-9312d58f-6324-404d-a6a4-0fdccfb09be4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a2e782cf-9773-4ca9-8cda-5c2588d3945b tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-5ae89146-a4d8-4854-849c-4085f0d0380f" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a2e782cf-9773-4ca9-8cda-5c2588d3945b tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-5ae89146-a4d8-4854-849c-4085f0d0380f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-a2e782cf-9773-4ca9-8cda-5c2588d3945b tempest-ProjectMemberTests-864664885 None] Deleting offline snapshot 5ae89146-a4d8-4854-849c-4085f0d0380f of volume 9312d58f-6324-404d-a6a4-0fdccfb09be4 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-a2e782cf-9773-4ca9-8cda-5c2588d3945b tempest-ProjectMemberTests-864664885 None] snapshot_file for this snap is: volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.5ae89146-a4d8-4854-849c-4085f0d0380f {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[612fa09d-eb51-4a6c-a331-3235082466b0]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a2e782cf-9773-4ca9-8cda-5c2588d3945b tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.5ae89146-a4d8-4854-849c-4085f0d0380f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:26 devstack sudo[107464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.5ae89146-a4d8-4854-849c-4085f0d0380f
Sep 16 16:33:26 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:26 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b 1073741824" returned: 0 in 0.467s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:26 devstack sudo[107472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b
Sep 16 16:33:26 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:26 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a2e782cf-9773-4ca9-8cda-5c2588d3945b tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.5ae89146-a4d8-4854-849c-4085f0d0380f" returned: 0 in 0.449s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-a2e782cf-9773-4ca9-8cda-5c2588d3945b tempest-ProjectMemberTests-864664885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9312d58f-6324-404d-a6a4-0fdccfb09be4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d53c22-d68c-47e8-8a01-fe925e371108]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:26 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a2e782cf-9773-4ca9-8cda-5c2588d3945b tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:27 devstack sudo[107474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4
Sep 16 16:33:27 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:27 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b" returned: 0 in 0.321s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:27 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:33:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18e2b4e-e40d-4787-89a7-64e36ac37621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba57bbca-63c1-439f-b485-be532fc2858b', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7650df-7703-475a-8d52-6530c4ce56b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:27 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Volume volume-ba57bbca-63c1-439f-b485-be532fc2858b (ba57bbca-63c1-439f-b485-be532fc2858b): created successfully
Sep 16 16:33:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7650df-7703-475a-8d52-6530c4ce56b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:27 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Flow 'volume_create_manager' (0c151b4d-cd2b-4125-b65a-8341b96c826f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:33:27 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b9b45fcb-1516-4eb1-90ac-fe255824f0b8 tempest-ProjectReaderTests-1980496335 None] Created volume successfully.
Sep 16 16:33:27 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a2e782cf-9773-4ca9-8cda-5c2588d3945b tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4" returned: 0 in 0.457s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a2e782cf-9773-4ca9-8cda-5c2588d3945b tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.5ae89146-a4d8-4854-849c-4085f0d0380f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:27 devstack sudo[107480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.5ae89146-a4d8-4854-849c-4085f0d0380f
Sep 16 16:33:27 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:27 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a2e782cf-9773-4ca9-8cda-5c2588d3945b tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.5ae89146-a4d8-4854-849c-4085f0d0380f" returned: 0 in 0.326s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:27 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a2e782cf-9773-4ca9-8cda-5c2588d3945b tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.5ae89146-a4d8-4854-849c-4085f0d0380f {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:27 devstack sudo[107486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.5ae89146-a4d8-4854-849c-4085f0d0380f
Sep 16 16:33:27 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:28 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-a2e782cf-9773-4ca9-8cda-5c2588d3945b tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4.5ae89146-a4d8-4854-849c-4085f0d0380f" returned: 0 in 0.236s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a2e782cf-9773-4ca9-8cda-5c2588d3945b tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-5ae89146-a4d8-4854-849c-4085f0d0380f" released by "_delete_snapshot" :: held 1.582s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a2e782cf-9773-4ca9-8cda-5c2588d3945b tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-9312d58f-6324-404d-a6a4-0fdccfb09be4" released by "delete_snapshot" :: held 1.605s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:28 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-a2e782cf-9773-4ca9-8cda-5c2588d3945b tempest-ProjectMemberTests-864664885 None] Created reservations ['360a8d9e-0afb-4c5e-9c76-2a1d91a248fd', '5656c1dd-485b-4eee-9cf9-83cb24833fef', '2c962163-fc25-4949-a3bd-ad5194222d6b', 'fdca78c4-86e9-4ef6-853a-de631c5c4632'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:33:28 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-a2e782cf-9773-4ca9-8cda-5c2588d3945b tempest-ProjectMemberTests-864664885 None] Delete snapshot completed successfully.
Sep 16 16:33:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-a2e782cf-9773-4ca9-8cda-5c2588d3945b tempest-ProjectMemberTests-864664885 None] Lock "cinder-5ae89146-a4d8-4854-849c-4085f0d0380f-delete_snapshot" released by "delete_snapshot" :: held 1.735s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-eac03d2e-2779-41b8-a013-a5e7d2324392 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-eac03d2e-2779-41b8-a013-a5e7d2324392 tempest-ProjectReaderTests-1980496335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:28 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-eac03d2e-2779-41b8-a013-a5e7d2324392 tempest-ProjectReaderTests-1980496335 None] Creating offline snapshot 2a111791-dbbb-4e9c-a18a-8c85cf40cc82 of volume ba57bbca-63c1-439f-b485-be532fc2858b {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:33:28 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7256935-9830-4695-a549-5e8b9911c8cf]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eac03d2e-2779-41b8-a013-a5e7d2324392 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-edf63877-b8c0-49cd-8154-7c3c2e433e6a tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-9312d58f-6324-404d-a6a4-0fdccfb09be4-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-edf63877-b8c0-49cd-8154-7c3c2e433e6a tempest-ProjectMemberTests-864664885 None] Lock "cinder-9312d58f-6324-404d-a6a4-0fdccfb09be4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-edf63877-b8c0-49cd-8154-7c3c2e433e6a tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-9312d58f-6324-404d-a6a4-0fdccfb09be4" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:28 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-edf63877-b8c0-49cd-8154-7c3c2e433e6a tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-9312d58f-6324-404d-a6a4-0fdccfb09be4" acquired by "delete_volume" :: waited 0.018s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:28 devstack sudo[107489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b
Sep 16 16:33:28 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:28 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ce5edb-366c-41c7-8d3c-f2512d549afc]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:28 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-edf63877-b8c0-49cd-8154-7c3c2e433e6a tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:28 devstack sudo[107491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4
Sep 16 16:33:28 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:29 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eac03d2e-2779-41b8-a013-a5e7d2324392 tempest-ProjectReaderTests-1980496335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b" returned: 0 in 0.474s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eac03d2e-2779-41b8-a013-a5e7d2324392 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.2a111791-dbbb-4e9c-a18a-8c85cf40cc82 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:29 devstack sudo[107497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.2a111791-dbbb-4e9c-a18a-8c85cf40cc82 1G
Sep 16 16:33:29 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:29 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-edf63877-b8c0-49cd-8154-7c3c2e433e6a tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4" returned: 0 in 0.464s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-edf63877-b8c0-49cd-8154-7c3c2e433e6a tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:29 devstack sudo[107502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4
Sep 16 16:33:29 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:29 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-edf63877-b8c0-49cd-8154-7c3c2e433e6a tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9312d58f-6324-404d-a6a4-0fdccfb09be4" returned: 0 in 0.265s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:29 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eac03d2e-2779-41b8-a013-a5e7d2324392 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.2a111791-dbbb-4e9c-a18a-8c85cf40cc82 1G" returned: 0 in 0.436s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eac03d2e-2779-41b8-a013-a5e7d2324392 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba57bbca-63c1-439f-b485-be532fc2858b -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.2a111791-dbbb-4e9c-a18a-8c85cf40cc82 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-edf63877-b8c0-49cd-8154-7c3c2e433e6a tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-9312d58f-6324-404d-a6a4-0fdccfb09be4" released by "delete_volume" :: held 0.808s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:29 devstack sudo[107508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba57bbca-63c1-439f-b485-be532fc2858b -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.2a111791-dbbb-4e9c-a18a-8c85cf40cc82
Sep 16 16:33:29 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:29 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-edf63877-b8c0-49cd-8154-7c3c2e433e6a tempest-ProjectMemberTests-864664885 None] Created reservations ['ba955006-2d00-48bc-84ba-bb8bb21cf69c', 'c00cf826-6a19-4896-9362-b1460ed229ed', '9dc020a5-8e15-4d8c-9010-7acdcbb18599', 'be5db0a1-46a9-4cbc-a2b9-2ce14c425231'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:33:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-edf63877-b8c0-49cd-8154-7c3c2e433e6a tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-edf63877-b8c0-49cd-8154-7c3c2e433e6a tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-edf63877-b8c0-49cd-8154-7c3c2e433e6a tempest-ProjectMemberTests-864664885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:33:29 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-edf63877-b8c0-49cd-8154-7c3c2e433e6a tempest-ProjectMemberTests-864664885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:33:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-edf63877-b8c0-49cd-8154-7c3c2e433e6a tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-edf63877-b8c0-49cd-8154-7c3c2e433e6a tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:29 devstack sudo[107510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:33:29 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:29 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eac03d2e-2779-41b8-a013-a5e7d2324392 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba57bbca-63c1-439f-b485-be532fc2858b -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.2a111791-dbbb-4e9c-a18a-8c85cf40cc82" returned: 0 in 0.388s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:29 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-eac03d2e-2779-41b8-a013-a5e7d2324392 tempest-ProjectReaderTests-1980496335 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.2a111791-dbbb-4e9c-a18a-8c85cf40cc82 is being set with open permissions: ugo+rw
Sep 16 16:33:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eac03d2e-2779-41b8-a013-a5e7d2324392 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.2a111791-dbbb-4e9c-a18a-8c85cf40cc82 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:29 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:29 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-edf63877-b8c0-49cd-8154-7c3c2e433e6a tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.274s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:29 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-edf63877-b8c0-49cd-8154-7c3c2e433e6a tempest-ProjectMemberTests-864664885 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:33:29 devstack sudo[107517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.2a111791-dbbb-4e9c-a18a-8c85cf40cc82
Sep 16 16:33:29 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:29 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-edf63877-b8c0-49cd-8154-7c3c2e433e6a tempest-ProjectMemberTests-864664885 None] Deleted volume successfully.
Sep 16 16:33:29 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-edf63877-b8c0-49cd-8154-7c3c2e433e6a tempest-ProjectMemberTests-864664885 None] Lock "cinder-9312d58f-6324-404d-a6a4-0fdccfb09be4-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:30 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eac03d2e-2779-41b8-a013-a5e7d2324392 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.2a111791-dbbb-4e9c-a18a-8c85cf40cc82" returned: 0 in 0.334s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eac03d2e-2779-41b8-a013-a5e7d2324392 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:30 devstack sudo[107520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.info
Sep 16 16:33:30 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Flow 'volume_create_manager' (cc8c9970-5802-4c89-8a9e-0ca20752071f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd20d56-1fde-4df0-98dc-fab4070cb0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd20d56-1fde-4df0-98dc-fab4070cb0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1135987227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9b94f9-330d-4752-bd53-4a57626d2960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4be84013f847d4a2f15dde740a2536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:33:30Z,use_quota=True,user_id='ae825737116546298fd942e8502abe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a8945d-c8e1-4dac-b413-99abf802e29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a8945d-c8e1-4dac-b413-99abf802e29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c230541-3b69-4864-99fb-47e132d39f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c230541-3b69-4864-99fb-47e132d39f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd9b94f9-330d-4752-bd53-4a57626d2960', 'volume_name': 'volume-dd9b94f9-330d-4752-bd53-4a57626d2960', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509580b7-83c2-4ba4-bc86-8e656d6b3bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509580b7-83c2-4ba4-bc86-8e656d6b3bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1be96bf-6393-4ab6-b4a1-d50036b54c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:30 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Volume dd9b94f9-330d-4752-bd53-4a57626d2960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd9b94f9-330d-4752-bd53-4a57626d2960', 'volume_size': 1}
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:30 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eac03d2e-2779-41b8-a013-a5e7d2324392 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.info" returned: 0 in 0.254s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:30 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-eac03d2e-2779-41b8-a013-a5e7d2324392 tempest-ProjectReaderTests-1980496335 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.info is being set with open permissions: ugo+rw
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eac03d2e-2779-41b8-a013-a5e7d2324392 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:30 devstack sudo[107523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.info
Sep 16 16:33:30 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:30 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-eac03d2e-2779-41b8-a013-a5e7d2324392 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.info" returned: 0 in 0.239s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-eac03d2e-2779-41b8-a013-a5e7d2324392 tempest-ProjectReaderTests-1980496335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.221s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1135987227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9b94f9-330d-4752-bd53-4a57626d2960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4be84013f847d4a2f15dde740a2536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:33:30Z,use_quota=True,user_id='ae825737116546298fd942e8502abe63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Creating volume dd9b94f9-330d-4752-bd53-4a57626d2960 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:33:30 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:33:30 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:30 devstack sudo[107526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960 1073741824
Sep 16 16:33:30 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:30 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-eac03d2e-2779-41b8-a013-a5e7d2324392 tempest-ProjectReaderTests-1980496335 None] Create snapshot completed successfully
Sep 16 16:33:31 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960 1073741824" returned: 0 in 0.458s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:31 devstack sudo[107532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960
Sep 16 16:33:31 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:31 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960" returned: 0 in 0.256s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:33:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1be96bf-6393-4ab6-b4a1-d50036b54c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd9b94f9-330d-4752-bd53-4a57626d2960', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91be22a3-b5b4-4894-a023-9e4b62dfd87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:31 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Volume volume-dd9b94f9-330d-4752-bd53-4a57626d2960 (dd9b94f9-330d-4752-bd53-4a57626d2960): created successfully
Sep 16 16:33:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91be22a3-b5b4-4894-a023-9e4b62dfd87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:31 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Flow 'volume_create_manager' (cc8c9970-5802-4c89-8a9e-0ca20752071f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:33:31 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-8967b113-a516-4d92-bae5-013981a5b6b7 tempest-ProjectMemberTests-864664885 None] Created volume successfully.
Sep 16 16:33:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-648513a2-7e78-4295-820e-e210341baec4 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-2a111791-dbbb-4e9c-a18a-8c85cf40cc82-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-648513a2-7e78-4295-820e-e210341baec4 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-2a111791-dbbb-4e9c-a18a-8c85cf40cc82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-648513a2-7e78-4295-820e-e210341baec4 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-quobyte-ba57bbca-63c1-439f-b485-be532fc2858b" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-648513a2-7e78-4295-820e-e210341baec4 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-ba57bbca-63c1-439f-b485-be532fc2858b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-648513a2-7e78-4295-820e-e210341baec4 tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-quobyte-2a111791-dbbb-4e9c-a18a-8c85cf40cc82" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:31 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-648513a2-7e78-4295-820e-e210341baec4 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-2a111791-dbbb-4e9c-a18a-8c85cf40cc82" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-648513a2-7e78-4295-820e-e210341baec4 tempest-ProjectReaderTests-1980496335 None] Deleting offline snapshot 2a111791-dbbb-4e9c-a18a-8c85cf40cc82 of volume ba57bbca-63c1-439f-b485-be532fc2858b {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:33:31 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-648513a2-7e78-4295-820e-e210341baec4 tempest-ProjectReaderTests-1980496335 None] snapshot_file for this snap is: volume-ba57bbca-63c1-439f-b485-be532fc2858b.2a111791-dbbb-4e9c-a18a-8c85cf40cc82 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:33:31 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1951312b-7727-41a3-ab44-689ab315e33c]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:31 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-648513a2-7e78-4295-820e-e210341baec4 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.2a111791-dbbb-4e9c-a18a-8c85cf40cc82 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:31 devstack sudo[107535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.2a111791-dbbb-4e9c-a18a-8c85cf40cc82
Sep 16 16:33:31 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:32 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-648513a2-7e78-4295-820e-e210341baec4 tempest-ProjectReaderTests-1980496335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.2a111791-dbbb-4e9c-a18a-8c85cf40cc82" returned: 0 in 0.361s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-648513a2-7e78-4295-820e-e210341baec4 tempest-ProjectReaderTests-1980496335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba57bbca-63c1-439f-b485-be532fc2858b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:33:32 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[947fba86-b684-4511-8b73-6fe7a92e9eb8]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-648513a2-7e78-4295-820e-e210341baec4 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:32 devstack sudo[107540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b
Sep 16 16:33:32 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:32 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-648513a2-7e78-4295-820e-e210341baec4 tempest-ProjectReaderTests-1980496335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b" returned: 0 in 0.400s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-648513a2-7e78-4295-820e-e210341baec4 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.2a111791-dbbb-4e9c-a18a-8c85cf40cc82 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:32 devstack sudo[107545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.2a111791-dbbb-4e9c-a18a-8c85cf40cc82
Sep 16 16:33:32 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-650df304-5393-4d51-b39e-b171d5f48661 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-650df304-5393-4d51-b39e-b171d5f48661 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:32 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-650df304-5393-4d51-b39e-b171d5f48661 tempest-ProjectMemberTests-864664885 None] Creating offline snapshot 26e0e746-7506-4a5e-8f9e-c3b14a7d8699 of volume dd9b94f9-330d-4752-bd53-4a57626d2960 {{(pid=86165) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 16 16:33:32 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[880209dc-ac8d-4618-8469-d233fb0f307c]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-650df304-5393-4d51-b39e-b171d5f48661 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:32 devstack sudo[107547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960
Sep 16 16:33:32 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:32 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-648513a2-7e78-4295-820e-e210341baec4 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.2a111791-dbbb-4e9c-a18a-8c85cf40cc82" returned: 0 in 0.366s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:32 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-648513a2-7e78-4295-820e-e210341baec4 tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.2a111791-dbbb-4e9c-a18a-8c85cf40cc82 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:32 devstack sudo[107552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.2a111791-dbbb-4e9c-a18a-8c85cf40cc82
Sep 16 16:33:32 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:33 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-650df304-5393-4d51-b39e-b171d5f48661 tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960" returned: 0 in 0.395s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-650df304-5393-4d51-b39e-b171d5f48661 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.26e0e746-7506-4a5e-8f9e-c3b14a7d8699 1G {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:33 devstack sudo[107557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.26e0e746-7506-4a5e-8f9e-c3b14a7d8699 1G
Sep 16 16:33:33 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:33 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-648513a2-7e78-4295-820e-e210341baec4 tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b.2a111791-dbbb-4e9c-a18a-8c85cf40cc82" returned: 0 in 0.295s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-648513a2-7e78-4295-820e-e210341baec4 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-2a111791-dbbb-4e9c-a18a-8c85cf40cc82" released by "_delete_snapshot" :: held 1.526s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-648513a2-7e78-4295-820e-e210341baec4 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-ba57bbca-63c1-439f-b485-be532fc2858b" released by "delete_snapshot" :: held 1.551s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:33 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-648513a2-7e78-4295-820e-e210341baec4 tempest-ProjectReaderTests-1980496335 None] Created reservations ['2b5a4b38-d026-4e27-aefd-1245ec89f6c3', '4af1c0e0-cb56-49d0-9177-f40f434e663f', 'f776c10c-5edf-4341-97a6-12840b9c0d14', '60bda469-f651-411e-aef7-78bba9726460'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:33:33 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-648513a2-7e78-4295-820e-e210341baec4 tempest-ProjectReaderTests-1980496335 None] Delete snapshot completed successfully.
Sep 16 16:33:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-648513a2-7e78-4295-820e-e210341baec4 tempest-ProjectReaderTests-1980496335 None] Lock "cinder-2a111791-dbbb-4e9c-a18a-8c85cf40cc82-delete_snapshot" released by "delete_snapshot" :: held 1.720s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:33 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-650df304-5393-4d51-b39e-b171d5f48661 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.26e0e746-7506-4a5e-8f9e-c3b14a7d8699 1G" returned: 0 in 0.509s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-650df304-5393-4d51-b39e-b171d5f48661 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd9b94f9-330d-4752-bd53-4a57626d2960 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.26e0e746-7506-4a5e-8f9e-c3b14a7d8699 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:33 devstack sudo[107564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd9b94f9-330d-4752-bd53-4a57626d2960 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.26e0e746-7506-4a5e-8f9e-c3b14a7d8699
Sep 16 16:33:33 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b2e9df1c-9e09-4a65-a0f7-662180014bff tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-ba57bbca-63c1-439f-b485-be532fc2858b-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b2e9df1c-9e09-4a65-a0f7-662180014bff tempest-ProjectReaderTests-1980496335 None] Lock "cinder-ba57bbca-63c1-439f-b485-be532fc2858b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b2e9df1c-9e09-4a65-a0f7-662180014bff tempest-ProjectReaderTests-1980496335 None] Acquiring lock "cinder-quobyte-ba57bbca-63c1-439f-b485-be532fc2858b" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:33 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-650df304-5393-4d51-b39e-b171d5f48661 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd9b94f9-330d-4752-bd53-4a57626d2960 -F qcow2 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.26e0e746-7506-4a5e-8f9e-c3b14a7d8699" returned: 0 in 0.374s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:33 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-650df304-5393-4d51-b39e-b171d5f48661 tempest-ProjectMemberTests-864664885 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.26e0e746-7506-4a5e-8f9e-c3b14a7d8699 is being set with open permissions: ugo+rw
Sep 16 16:33:33 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-650df304-5393-4d51-b39e-b171d5f48661 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.26e0e746-7506-4a5e-8f9e-c3b14a7d8699 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:33 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b2e9df1c-9e09-4a65-a0f7-662180014bff tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-ba57bbca-63c1-439f-b485-be532fc2858b" acquired by "delete_volume" :: waited 0.028s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:33 devstack sudo[107570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.26e0e746-7506-4a5e-8f9e-c3b14a7d8699
Sep 16 16:33:33 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:34 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d87380-de96-434c-a662-3dd732e7e475]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b2e9df1c-9e09-4a65-a0f7-662180014bff tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:34 devstack sudo[107572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b
Sep 16 16:33:34 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:34 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-650df304-5393-4d51-b39e-b171d5f48661 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.26e0e746-7506-4a5e-8f9e-c3b14a7d8699" returned: 0 in 0.282s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-650df304-5393-4d51-b39e-b171d5f48661 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:34 devstack sudo[107575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.info
Sep 16 16:33:34 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:34 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b2e9df1c-9e09-4a65-a0f7-662180014bff tempest-ProjectReaderTests-1980496335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b" returned: 0 in 0.417s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b2e9df1c-9e09-4a65-a0f7-662180014bff tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:34 devstack sudo[107580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b
Sep 16 16:33:34 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:34 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-650df304-5393-4d51-b39e-b171d5f48661 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.info" returned: 0 in 0.320s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:34 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.remotefs [None req-650df304-5393-4d51-b39e-b171d5f48661 tempest-ProjectMemberTests-864664885 None] /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.info is being set with open permissions: ugo+rw
Sep 16 16:33:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-650df304-5393-4d51-b39e-b171d5f48661 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.info {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:34 devstack sudo[107583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.info
Sep 16 16:33:34 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:34 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b2e9df1c-9e09-4a65-a0f7-662180014bff tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-ba57bbca-63c1-439f-b485-be532fc2858b" returned: 0 in 0.291s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:34 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b2e9df1c-9e09-4a65-a0f7-662180014bff tempest-ProjectReaderTests-1980496335 None] Lock "cinder-quobyte-ba57bbca-63c1-439f-b485-be532fc2858b" released by "delete_volume" :: held 0.800s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:34 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-b2e9df1c-9e09-4a65-a0f7-662180014bff tempest-ProjectReaderTests-1980496335 None] Created reservations ['af9eb47f-35b1-4954-aedb-231760b9ce85', '4ebd27f6-42a4-4306-b282-2c17eb28d614', '13159318-34bd-4e3d-a643-e23ba3cab42c', 'a41c1597-8e38-4d9c-b6ca-ddf57e9b102d'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:33:34 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-650df304-5393-4d51-b39e-b171d5f48661 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.info" returned: 0 in 0.282s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-650df304-5393-4d51-b39e-b171d5f48661 tempest-ProjectMemberTests-864664885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.279s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b2e9df1c-9e09-4a65-a0f7-662180014bff tempest-ProjectReaderTests-1980496335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b2e9df1c-9e09-4a65-a0f7-662180014bff tempest-ProjectReaderTests-1980496335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b2e9df1c-9e09-4a65-a0f7-662180014bff tempest-ProjectReaderTests-1980496335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:33:34 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-b2e9df1c-9e09-4a65-a0f7-662180014bff tempest-ProjectReaderTests-1980496335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:33:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-b2e9df1c-9e09-4a65-a0f7-662180014bff tempest-ProjectReaderTests-1980496335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:34 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b2e9df1c-9e09-4a65-a0f7-662180014bff tempest-ProjectReaderTests-1980496335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:34 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-650df304-5393-4d51-b39e-b171d5f48661 tempest-ProjectMemberTests-864664885 None] Create snapshot completed successfully
Sep 16 16:33:34 devstack sudo[107587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:33:34 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:35 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:35 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b2e9df1c-9e09-4a65-a0f7-662180014bff tempest-ProjectReaderTests-1980496335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.291s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:35 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-b2e9df1c-9e09-4a65-a0f7-662180014bff tempest-ProjectReaderTests-1980496335 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:33:35 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b2e9df1c-9e09-4a65-a0f7-662180014bff tempest-ProjectReaderTests-1980496335 None] Deleted volume successfully.
Sep 16 16:33:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b2e9df1c-9e09-4a65-a0f7-662180014bff tempest-ProjectReaderTests-1980496335 None] Lock "cinder-ba57bbca-63c1-439f-b485-be532fc2858b-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b5c7b0e7-6aa7-42b0-9cd5-69b174b4dcbb tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-26e0e746-7506-4a5e-8f9e-c3b14a7d8699-delete_snapshot" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b5c7b0e7-6aa7-42b0-9cd5-69b174b4dcbb tempest-ProjectMemberTests-864664885 None] Lock "cinder-26e0e746-7506-4a5e-8f9e-c3b14a7d8699-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b5c7b0e7-6aa7-42b0-9cd5-69b174b4dcbb tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-dd9b94f9-330d-4752-bd53-4a57626d2960" by "delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b5c7b0e7-6aa7-42b0-9cd5-69b174b4dcbb tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-dd9b94f9-330d-4752-bd53-4a57626d2960" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:35 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b5c7b0e7-6aa7-42b0-9cd5-69b174b4dcbb tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-26e0e746-7506-4a5e-8f9e-c3b14a7d8699" by "_delete_snapshot" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:36 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b5c7b0e7-6aa7-42b0-9cd5-69b174b4dcbb tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-26e0e746-7506-4a5e-8f9e-c3b14a7d8699" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-b5c7b0e7-6aa7-42b0-9cd5-69b174b4dcbb tempest-ProjectMemberTests-864664885 None] Deleting offline snapshot 26e0e746-7506-4a5e-8f9e-c3b14a7d8699 of volume dd9b94f9-330d-4752-bd53-4a57626d2960 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 16 16:33:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-b5c7b0e7-6aa7-42b0-9cd5-69b174b4dcbb tempest-ProjectMemberTests-864664885 None] snapshot_file for this snap is: volume-dd9b94f9-330d-4752-bd53-4a57626d2960.26e0e746-7506-4a5e-8f9e-c3b14a7d8699 {{(pid=86165) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 16 16:33:36 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e49f806-95bf-443a-9251-d78bc585a4b0]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b5c7b0e7-6aa7-42b0-9cd5-69b174b4dcbb tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.26e0e746-7506-4a5e-8f9e-c3b14a7d8699 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:36 devstack sudo[107590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.26e0e746-7506-4a5e-8f9e-c3b14a7d8699
Sep 16 16:33:36 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:36 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b5c7b0e7-6aa7-42b0-9cd5-69b174b4dcbb tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.26e0e746-7506-4a5e-8f9e-c3b14a7d8699" returned: 0 in 0.450s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-b5c7b0e7-6aa7-42b0-9cd5-69b174b4dcbb tempest-ProjectMemberTests-864664885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd9b94f9-330d-4752-bd53-4a57626d2960(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86165) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 16 16:33:36 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0638437f-4220-49c1-8b5c-ef9a5aa872d5]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b5c7b0e7-6aa7-42b0-9cd5-69b174b4dcbb tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:36 devstack sudo[107596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960
Sep 16 16:33:36 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:36 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b5c7b0e7-6aa7-42b0-9cd5-69b174b4dcbb tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960" returned: 0 in 0.407s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b5c7b0e7-6aa7-42b0-9cd5-69b174b4dcbb tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.26e0e746-7506-4a5e-8f9e-c3b14a7d8699 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:37 devstack sudo[107601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.26e0e746-7506-4a5e-8f9e-c3b14a7d8699
Sep 16 16:33:37 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:37 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b5c7b0e7-6aa7-42b0-9cd5-69b174b4dcbb tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.26e0e746-7506-4a5e-8f9e-c3b14a7d8699" returned: 0 in 0.378s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b5c7b0e7-6aa7-42b0-9cd5-69b174b4dcbb tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.26e0e746-7506-4a5e-8f9e-c3b14a7d8699 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:37 devstack sudo[107607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.26e0e746-7506-4a5e-8f9e-c3b14a7d8699
Sep 16 16:33:37 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:37 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-b5c7b0e7-6aa7-42b0-9cd5-69b174b4dcbb tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960.26e0e746-7506-4a5e-8f9e-c3b14a7d8699" returned: 0 in 0.263s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b5c7b0e7-6aa7-42b0-9cd5-69b174b4dcbb tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-26e0e746-7506-4a5e-8f9e-c3b14a7d8699" released by "_delete_snapshot" :: held 1.633s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b5c7b0e7-6aa7-42b0-9cd5-69b174b4dcbb tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-dd9b94f9-330d-4752-bd53-4a57626d2960" released by "delete_snapshot" :: held 1.658s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:37 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-b5c7b0e7-6aa7-42b0-9cd5-69b174b4dcbb tempest-ProjectMemberTests-864664885 None] Created reservations ['1df43ce9-98c0-4ece-87cb-57a73b181eb3', 'b157906a-72d8-4e9c-b59c-c33c2b3ba481', '5db000e9-0193-4841-9000-05973c823dd5', '476b0ac7-f3f4-49ff-814e-1d8fc8148d10'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:33:37 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-b5c7b0e7-6aa7-42b0-9cd5-69b174b4dcbb tempest-ProjectMemberTests-864664885 None] Delete snapshot completed successfully.
Sep 16 16:33:37 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-b5c7b0e7-6aa7-42b0-9cd5-69b174b4dcbb tempest-ProjectMemberTests-864664885 None] Lock "cinder-26e0e746-7506-4a5e-8f9e-c3b14a7d8699-delete_snapshot" released by "delete_snapshot" :: held 1.816s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-084dbef5-4bc0-4166-a1c9-019b55e359e4 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-dd9b94f9-330d-4752-bd53-4a57626d2960-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-084dbef5-4bc0-4166-a1c9-019b55e359e4 tempest-ProjectMemberTests-864664885 None] Lock "cinder-dd9b94f9-330d-4752-bd53-4a57626d2960-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-084dbef5-4bc0-4166-a1c9-019b55e359e4 tempest-ProjectMemberTests-864664885 None] Acquiring lock "cinder-quobyte-dd9b94f9-330d-4752-bd53-4a57626d2960" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-084dbef5-4bc0-4166-a1c9-019b55e359e4 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-dd9b94f9-330d-4752-bd53-4a57626d2960" acquired by "delete_volume" :: waited 0.016s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:38 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a14d8d4-a99c-4dcd-9b8e-3a1d2d599a40]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-084dbef5-4bc0-4166-a1c9-019b55e359e4 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:38 devstack sudo[107610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960
Sep 16 16:33:38 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:38 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-084dbef5-4bc0-4166-a1c9-019b55e359e4 tempest-ProjectMemberTests-864664885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960" returned: 0 in 0.417s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-084dbef5-4bc0-4166-a1c9-019b55e359e4 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:38 devstack sudo[107615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960
Sep 16 16:33:38 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:38 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-084dbef5-4bc0-4166-a1c9-019b55e359e4 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-dd9b94f9-330d-4752-bd53-4a57626d2960" returned: 0 in 0.271s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:38 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-084dbef5-4bc0-4166-a1c9-019b55e359e4 tempest-ProjectMemberTests-864664885 None] Lock "cinder-quobyte-dd9b94f9-330d-4752-bd53-4a57626d2960" released by "delete_volume" :: held 0.755s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:39 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-084dbef5-4bc0-4166-a1c9-019b55e359e4 tempest-ProjectMemberTests-864664885 None] Created reservations ['551799cd-252c-4edc-81c8-ebd0da7d7217', '094c8e0b-3e87-415b-9f67-b937f538b02a', '79e5bf62-30fc-4448-82c7-aeb659b7cf67', '6fd558b8-e841-40ed-8d84-ae96800c7e23'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:33:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-084dbef5-4bc0-4166-a1c9-019b55e359e4 tempest-ProjectMemberTests-864664885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-084dbef5-4bc0-4166-a1c9-019b55e359e4 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-084dbef5-4bc0-4166-a1c9-019b55e359e4 tempest-ProjectMemberTests-864664885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:33:39 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-084dbef5-4bc0-4166-a1c9-019b55e359e4 tempest-ProjectMemberTests-864664885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:33:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-084dbef5-4bc0-4166-a1c9-019b55e359e4 tempest-ProjectMemberTests-864664885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-084dbef5-4bc0-4166-a1c9-019b55e359e4 tempest-ProjectMemberTests-864664885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:39 devstack sudo[107618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:33:39 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:39 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:39 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-084dbef5-4bc0-4166-a1c9-019b55e359e4 tempest-ProjectMemberTests-864664885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.273s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:39 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-084dbef5-4bc0-4166-a1c9-019b55e359e4 tempest-ProjectMemberTests-864664885 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:33:39 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-084dbef5-4bc0-4166-a1c9-019b55e359e4 tempest-ProjectMemberTests-864664885 None] Deleted volume successfully.
Sep 16 16:33:39 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-084dbef5-4bc0-4166-a1c9-019b55e359e4 tempest-ProjectMemberTests-864664885 None] Lock "cinder-dd9b94f9-330d-4752-bd53-4a57626d2960-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:43 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:33:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Flow 'volume_create_manager' (ef150214-2c26-445f-8f1e-4d52ebda2cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:33:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9eda87c-6ee2-46fa-b1a6-35078ae316c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9eda87c-6ee2-46fa-b1a6-35078ae316c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1139967727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0f6c93-b53e-419e-888a-98837180f5b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='533e0f0211f649e1a4b3a0e021f89ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:33:43Z,use_quota=True,user_id='7dd2dac8c1e446149d6cde2bbaa32f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ca48f5-1137-4c9b-8926-9238ea74bdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ca48f5-1137-4c9b-8926-9238ea74bdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c05a94-e5d7-41b4-95e8-0c7f4f77fa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c05a94-e5d7-41b4-95e8-0c7f4f77fa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d0f6c93-b53e-419e-888a-98837180f5b9', 'volume_name': 'volume-9d0f6c93-b53e-419e-888a-98837180f5b9', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213f8e45-9906-49dc-86c5-5b81d40dc0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213f8e45-9906-49dc-86c5-5b81d40dc0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:43 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1288358d-5bf6-4a39-a0f3-f721da6eac5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:43 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Volume 9d0f6c93-b53e-419e-888a-98837180f5b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d0f6c93-b53e-419e-888a-98837180f5b9', 'volume_size': 1}
Sep 16 16:33:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1139967727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0f6c93-b53e-419e-888a-98837180f5b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='533e0f0211f649e1a4b3a0e021f89ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:33:43Z,use_quota=True,user_id='7dd2dac8c1e446149d6cde2bbaa32f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:33:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Creating volume 9d0f6c93-b53e-419e-888a-98837180f5b9 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:33:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:33:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:33:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:43 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:33:43 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:33:43 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d0f6c93-b53e-419e-888a-98837180f5b9 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:43 devstack sudo[107624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d0f6c93-b53e-419e-888a-98837180f5b9 1073741824
Sep 16 16:33:43 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:44 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d0f6c93-b53e-419e-888a-98837180f5b9 1073741824" returned: 0 in 0.524s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d0f6c93-b53e-419e-888a-98837180f5b9 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:44 devstack sudo[107629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d0f6c93-b53e-419e-888a-98837180f5b9
Sep 16 16:33:44 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:44 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d0f6c93-b53e-419e-888a-98837180f5b9" returned: 0 in 0.271s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:44 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:33:44 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1288358d-5bf6-4a39-a0f3-f721da6eac5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d0f6c93-b53e-419e-888a-98837180f5b9', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d50df15-1d1b-4ca6-b297-c9cfdb10f6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:44 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Volume volume-9d0f6c93-b53e-419e-888a-98837180f5b9 (9d0f6c93-b53e-419e-888a-98837180f5b9): created successfully
Sep 16 16:33:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d50df15-1d1b-4ca6-b297-c9cfdb10f6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:44 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Flow 'volume_create_manager' (ef150214-2c26-445f-8f1e-4d52ebda2cf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:33:44 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-4af2df0f-ac80-4b64-b79a-db966580857c tempest-ProjectReaderTests-943424565 None] Created volume successfully.
Sep 16 16:33:45 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7c921287-c679-44a2-92ef-1710698ee16f tempest-ProjectReaderTests-943424565 None] Acquiring lock "cinder-9d0f6c93-b53e-419e-888a-98837180f5b9-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:45 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7c921287-c679-44a2-92ef-1710698ee16f tempest-ProjectReaderTests-943424565 None] Lock "cinder-9d0f6c93-b53e-419e-888a-98837180f5b9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:45 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7c921287-c679-44a2-92ef-1710698ee16f tempest-ProjectReaderTests-943424565 None] Acquiring lock "cinder-quobyte-9d0f6c93-b53e-419e-888a-98837180f5b9" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:45 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7c921287-c679-44a2-92ef-1710698ee16f tempest-ProjectReaderTests-943424565 None] Lock "cinder-quobyte-9d0f6c93-b53e-419e-888a-98837180f5b9" acquired by "delete_volume" :: waited 0.018s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:45 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e78b51c-d239-4b81-86cd-8ece5797c4a3]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:45 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7c921287-c679-44a2-92ef-1710698ee16f tempest-ProjectReaderTests-943424565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d0f6c93-b53e-419e-888a-98837180f5b9 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:46 devstack sudo[107632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d0f6c93-b53e-419e-888a-98837180f5b9
Sep 16 16:33:46 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:46 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7c921287-c679-44a2-92ef-1710698ee16f tempest-ProjectReaderTests-943424565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d0f6c93-b53e-419e-888a-98837180f5b9" returned: 0 in 0.398s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7c921287-c679-44a2-92ef-1710698ee16f tempest-ProjectReaderTests-943424565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d0f6c93-b53e-419e-888a-98837180f5b9 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:46 devstack sudo[107637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d0f6c93-b53e-419e-888a-98837180f5b9
Sep 16 16:33:46 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:46 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7c921287-c679-44a2-92ef-1710698ee16f tempest-ProjectReaderTests-943424565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-9d0f6c93-b53e-419e-888a-98837180f5b9" returned: 0 in 0.275s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:46 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7c921287-c679-44a2-92ef-1710698ee16f tempest-ProjectReaderTests-943424565 None] Lock "cinder-quobyte-9d0f6c93-b53e-419e-888a-98837180f5b9" released by "delete_volume" :: held 0.725s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:46 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-7c921287-c679-44a2-92ef-1710698ee16f tempest-ProjectReaderTests-943424565 None] Created reservations ['1af0aeee-a1af-4552-b44b-3a1c952c5cc8', '610d23bf-66fb-4c0d-8cb2-93d12d0535cd', '7bd13100-279d-4237-b722-bce3a6855a28', 'f43b7b1a-999a-45b7-9d85-a840ffccb033'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:33:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7c921287-c679-44a2-92ef-1710698ee16f tempest-ProjectReaderTests-943424565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7c921287-c679-44a2-92ef-1710698ee16f tempest-ProjectReaderTests-943424565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:46 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7c921287-c679-44a2-92ef-1710698ee16f tempest-ProjectReaderTests-943424565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:33:46 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-7c921287-c679-44a2-92ef-1710698ee16f tempest-ProjectReaderTests-943424565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:33:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-7c921287-c679-44a2-92ef-1710698ee16f tempest-ProjectReaderTests-943424565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:46 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7c921287-c679-44a2-92ef-1710698ee16f tempest-ProjectReaderTests-943424565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:46 devstack sudo[107640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:33:46 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:46 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-7c921287-c679-44a2-92ef-1710698ee16f tempest-ProjectReaderTests-943424565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.265s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-7c921287-c679-44a2-92ef-1710698ee16f tempest-ProjectReaderTests-943424565 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:33:47 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-7c921287-c679-44a2-92ef-1710698ee16f tempest-ProjectReaderTests-943424565 None] Deleted volume successfully.
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-7c921287-c679-44a2-92ef-1710698ee16f tempest-ProjectReaderTests-943424565 None] Lock "cinder-9d0f6c93-b53e-419e-888a-98837180f5b9-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG cinder.volume.flows.manager.create_volume [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86165) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Flow 'volume_create_manager' (31bae22f-549f-4a96-82c8-c547d561adf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f298a5-e4c0-4f2b-91aa-9eb9147ab229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f298a5-e4c0-4f2b-91aa-9eb9147ab229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-410972817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f08db2b2-4bcf-460e-abb2-0b7af9d66ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='533e0f0211f649e1a4b3a0e021f89ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:33:47Z,use_quota=True,user_id='7dd2dac8c1e446149d6cde2bbaa32f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcadb54-e260-4cc5-a527-49f81b4c9a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcadb54-e260-4cc5-a527-49f81b4c9a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447fd898-1163-4d49-a963-4b0be4017463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447fd898-1163-4d49-a963-4b0be4017463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f08db2b2-4bcf-460e-abb2-0b7af9d66ed8', 'volume_name': 'volume-f08db2b2-4bcf-460e-abb2-0b7af9d66ed8', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0f5ad6-0275-4a08-8ec7-c9a3afa623fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0f5ad6-0275-4a08-8ec7-c9a3afa623fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (275270db-2605-497a-93ec-0e1af33bdd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:47 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Volume f08db2b2-4bcf-460e-abb2-0b7af9d66ed8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f08db2b2-4bcf-460e-abb2-0b7af9d66ed8', 'volume_size': 1}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7b2e4ef0a8d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-16T14:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-410972817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f08db2b2-4bcf-460e-abb2-0b7af9d66ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='533e0f0211f649e1a4b3a0e021f89ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:33:47Z,use_quota=True,user_id='7dd2dac8c1e446149d6cde2bbaa32f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8756a842-72b2-43cb-b051-d19b14211c34),volume_type_id=8756a842-72b2-43cb-b051-d19b14211c34)}" {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Creating volume f08db2b2-4bcf-460e-abb2-0b7af9d66ed8 {{(pid=86165) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Selected osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81 as target Quobyte volume. {{(pid=86165) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 16 16:33:47 devstack cinder-volume[86165]: INFO cinder.volume.drivers.remotefs [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] casted to osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f08db2b2-4bcf-460e-abb2-0b7af9d66ed8 1073741824 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:47 devstack sudo[107643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f08db2b2-4bcf-460e-abb2-0b7af9d66ed8 1073741824
Sep 16 16:33:47 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:47 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f08db2b2-4bcf-460e-abb2-0b7af9d66ed8 1073741824" returned: 0 in 0.419s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:47 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f08db2b2-4bcf-460e-abb2-0b7af9d66ed8 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:48 devstack sudo[107649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f08db2b2-4bcf-460e-abb2-0b7af9d66ed8
Sep 16 16:33:48 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:48 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f08db2b2-4bcf-460e-abb2-0b7af9d66ed8" returned: 0 in 0.230s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:48 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'} {{(pid=86165) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 16 16:33:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (275270db-2605-497a-93ec-0e1af33bdd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f08db2b2-4bcf-460e-abb2-0b7af9d66ed8', 'volume_size': 1}' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8dae79d-6d72-45b9-9742-83a8bc8e910d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 16 16:33:48 devstack cinder-volume[86165]: INFO cinder.volume.flows.manager.create_volume [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Volume volume-f08db2b2-4bcf-460e-abb2-0b7af9d66ed8 (f08db2b2-4bcf-460e-abb2-0b7af9d66ed8): created successfully
Sep 16 16:33:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8dae79d-6d72-45b9-9742-83a8bc8e910d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86165) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 16 16:33:48 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Flow 'volume_create_manager' (31bae22f-549f-4a96-82c8-c547d561adf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86165) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 16 16:33:48 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-85eba088-5ae3-466a-adbb-9134be70d318 tempest-ProjectReaderTests-943424565 None] Created volume successfully.
Sep 16 16:33:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9ae0ac07-7545-4fd2-9020-38e57ae33340 tempest-ProjectReaderTests-943424565 None] Acquiring lock "cinder-f08db2b2-4bcf-460e-abb2-0b7af9d66ed8-delete_volume" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9ae0ac07-7545-4fd2-9020-38e57ae33340 tempest-ProjectReaderTests-943424565 None] Lock "cinder-f08db2b2-4bcf-460e-abb2-0b7af9d66ed8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9ae0ac07-7545-4fd2-9020-38e57ae33340 tempest-ProjectReaderTests-943424565 None] Acquiring lock "cinder-quobyte-f08db2b2-4bcf-460e-abb2-0b7af9d66ed8" by "delete_volume" {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 16 16:33:48 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9ae0ac07-7545-4fd2-9020-38e57ae33340 tempest-ProjectReaderTests-943424565 None] Lock "cinder-quobyte-f08db2b2-4bcf-460e-abb2-0b7af9d66ed8" acquired by "delete_volume" :: waited 0.020s {{(pid=86165) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 16 16:33:48 devstack cinder-volume[86165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5afd91e-d551-4d38-a26a-f0d48376c3fa]: (4, 'qcow2') {{(pid=87857) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 16 16:33:48 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9ae0ac07-7545-4fd2-9020-38e57ae33340 tempest-ProjectReaderTests-943424565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f08db2b2-4bcf-460e-abb2-0b7af9d66ed8 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:48 devstack sudo[107652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f08db2b2-4bcf-460e-abb2-0b7af9d66ed8
Sep 16 16:33:48 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:49 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9ae0ac07-7545-4fd2-9020-38e57ae33340 tempest-ProjectReaderTests-943424565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f08db2b2-4bcf-460e-abb2-0b7af9d66ed8" returned: 0 in 0.424s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9ae0ac07-7545-4fd2-9020-38e57ae33340 tempest-ProjectReaderTests-943424565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f08db2b2-4bcf-460e-abb2-0b7af9d66ed8 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:49 devstack sudo[107657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f08db2b2-4bcf-460e-abb2-0b7af9d66ed8
Sep 16 16:33:49 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:49 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9ae0ac07-7545-4fd2-9020-38e57ae33340 tempest-ProjectReaderTests-943424565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442/volume-f08db2b2-4bcf-460e-abb2-0b7af9d66ed8" returned: 0 in 0.259s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:49 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9ae0ac07-7545-4fd2-9020-38e57ae33340 tempest-ProjectReaderTests-943424565 None] Lock "cinder-quobyte-f08db2b2-4bcf-460e-abb2-0b7af9d66ed8" released by "delete_volume" :: held 0.739s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:49 devstack cinder-volume[86165]: DEBUG cinder.quota [None req-9ae0ac07-7545-4fd2-9020-38e57ae33340 tempest-ProjectReaderTests-943424565 None] Created reservations ['b33f4e8c-0f9c-4447-bda2-69abee87a1fc', 'fbb5c2cc-201b-4756-a116-9d9a22e8f6b9', '0b4b3ac4-1fd0-4c21-9be9-1c34c238960e', '24c4233e-c867-4055-b622-ed876fd94831'] {{(pid=86165) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 16:33:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9ae0ac07-7545-4fd2-9020-38e57ae33340 tempest-ProjectReaderTests-943424565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:33:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9ae0ac07-7545-4fd2-9020-38e57ae33340 tempest-ProjectReaderTests-943424565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:33:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9ae0ac07-7545-4fd2-9020-38e57ae33340 tempest-ProjectReaderTests-943424565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:33:49 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-9ae0ac07-7545-4fd2-9020-38e57ae33340 tempest-ProjectReaderTests-943424565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:33:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-9ae0ac07-7545-4fd2-9020-38e57ae33340 tempest-ProjectReaderTests-943424565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:33:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9ae0ac07-7545-4fd2-9020-38e57ae33340 tempest-ProjectReaderTests-943424565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:33:49 devstack sudo[107660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:33:49 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:33:49 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root
Sep 16 16:33:49 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-9ae0ac07-7545-4fd2-9020-38e57ae33340 tempest-ProjectReaderTests-943424565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.280s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:33:49 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-9ae0ac07-7545-4fd2-9020-38e57ae33340 tempest-ProjectReaderTests-943424565 None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:33:49 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-9ae0ac07-7545-4fd2-9020-38e57ae33340 tempest-ProjectReaderTests-943424565 None] Deleted volume successfully.
Sep 16 16:33:49 devstack cinder-volume[86165]: DEBUG cinder.coordination [None req-9ae0ac07-7545-4fd2-9020-38e57ae33340 tempest-ProjectReaderTests-943424565 None] Lock "cinder-f08db2b2-4bcf-460e-abb2-0b7af9d66ed8-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=86165) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 16 16:33:59 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=148,cinder:SELECT=122,cinder:DELETE=11,cinder:INSERT=35 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:33:59 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writing DB stats cinder:UPDATE=152,cinder:SELECT=96,cinder:INSERT=43,cinder:DELETE=13 {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 16 16:34:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:34:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 16 16:34:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 16 16:34:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 16 16:34:07 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54451596-8cd0-4983-bbad-570519993e81'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 16 16:34:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 16 16:34:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442 {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 16 16:34:07 devstack sudo[107680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442
Sep 16 16:34:07 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 16:34:07 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root
Sep 16 16:34:07 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/142a851d1229dd4de22fefc17ba48442" returned: 0 in 0.277s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 16 16:34:07 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 16 16:34:07 devstack cinder-volume[86165]: DEBUG oslo_service.periodic_task [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] Running periodic task VolumeManager._thread_info {{(pid=86165) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 16 16:34:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread count: 29 {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 16 16:34:07 devstack cinder-volume[86165]: DEBUG cinder.volume.manager [None req-4a57fc86-046e-43ee-9215-1deb80d9d80b None None] thread info: [<_MainThread(MainThread, started 135438896550016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135438782951488)>, <Thread(Thread-3 (stat_writer), started daemon 135438781467392)>, <Thread(Rabbit-heartbeat, started daemon 135438782029568)>, <Thread(Thread-5 (_runner), started daemon 135438782150464)>, <Thread(Thread-7 (_runner), started daemon 135438780099904)>, <Thread(fd_logger, started daemon 135438776274560)>, <Thread(privsep_reader, started daemon 135438776282048)>, <Thread(tpool_thread_0, started daemon 135438770624192)>, <Thread(tpool_thread_1, started daemon 135438762231488)>, <Thread(tpool_thread_2, started daemon 135438753838784)>, <Thread(tpool_thread_3, started daemon 135438745446080)>, <Thread(tpool_thread_4, started daemon 135438737053376)>, <Thread(tpool_thread_5, started daemon 135438728660672)>, <Thread(tpool_thread_6, started daemon 135438720267968)>, <Thread(tpool_thread_7, started daemon 135438711875264)>, <Thread(tpool_thread_8, started daemon 135438703466176)>, <Thread(tpool_thread_9, started daemon 135438695057088)>, <Thread(tpool_thread_10, started daemon 135438686648000)>, <Thread(tpool_thread_11, started daemon 135438678238912)>, <Thread(tpool_thread_12, started daemon 135438669829824)>, <Thread(tpool_thread_13, started daemon 135438661420736)>, <Thread(tpool_thread_14, started daemon 135438653011648)>, <Thread(tpool_thread_15, started daemon 135438644602560)>, <Thread(tpool_thread_16, started daemon 135438636193472)>, <Thread(tpool_thread_17, started daemon 135438627784384)>, <Thread(tpool_thread_18, started daemon 135438619375296)>, <Thread(tpool_thread_19, started daemon 135438610966208)>, <Thread(Rabbit-heartbeat, started daemon 135438772197760)>] {{(pid=86165) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}